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ABSTRACT 


In  the  21st  century,   the  population  will  need  to  possess  basic  skills  In  the  areas  of  communication  and 
higher  probl em-sol v 1 ng  as  well  as  have  scientific  and  technological    literacy;  however,   results  from 
assessments  by  the  National  Assessment  of  Educational  Progress  (NAEP)  have  indicated  weak  student 
performance  In  the  area  of  thinking  skills,  making  inferences  from  printed  material,   and  interpreting  the 
meaning  of  scientific  data.  The  educational  community  has  called  for  Increased  emphasis  on  probl em-sol vi n 
and  higher  order  skills  In  NAEP's  1985-86  assessment.   The  goal  of  a  project,   as  funded  to  Investigate 
these  thinking  skills,  was  to  develop  and  test  a  variety  of  measures  for  use  In  a  future  national 
assessment.   Part  1  of  this  pilot  project  developed  and  assessed  the  quality  and  appropriateness  of  certai 
innovative  tasks  and  procedures  to  measure  the  higher-order  thinking  skills  used  in  science  and 
mathematics.   First,  a  conceptual   framework  of  higher-order  skills  used  in  science  and  mathematics,  then 
prototype  exercises,    including  "hands-on"  activities,  were  developed.  Some  exercises  were  adapted  from 
those  used  successfully  by  the  United  Kingdom's  Assessment  of  Performance  Unit   in  England.  Wales,  and 
Northern  Ireland.   These  efforts  resulted  In  a  set  of  tasks  which  asked  the  students  to  "think"  about  a 
variety  of  relationships  in  mathematics  and  science.  Three  categories  of  administrative  formats  were  used 
(1)  group  activities  to  Intact  classes,   (2)  station  activities  consisting  of   "hands-on"  tasks,  and  (3) 
full    investigations  which  were  administered  to  individual   students.  Almost  1 .OOO  students  in  grades  3.  7. 
and  11  from  12  districts  throughout  the  country  participated.  Scoring  guides  were  developed,  and  student 
responses  were  categorized,  entered  into  the  computer,   and  analyzed.  Results  showed  that  students  were 
responding  to  the  tasks,  and  data  conformed  to  expectations  about  basic  developmental   trends  in  thinking 
skills.   In  Part  II.   the  pilot-tested  tasks  are  presented  individually.  The  group  tashc  are  presented 
first,   followed  by  the  station  activities,  and  then  the  individually  administered  full    i  nv>'^st  1  gat  1  ons .  Th 
presentation  for  each  task  consists  first  of  the  task  as  the  students  saw  it;   followed  by  cHrections  for 
the  administrator  and  the  observation  checklist,  where  these  are  pertinent;  a  description  of  the 
apparatus;   the  scoring  guide  with  illustrative  examples  of  each  score  level;  and  summary  comments  about 
the  task.   The  data  on  which  the  comments  are  based  included  student  performance  on  each  task  by  grade  and 
by  sex  and  the  correlation  coefficient  between  the  number  right  on  the  mathematics  and  science  items  and 
student  data  for  most  of  the  tasks.   Separate  analyses  by  sex  were  conducted  to  determine  if  there  were  an 
obvious  gender  biases  in  the  tasks.  No  tests  for  significance  were  done  on  the  gender  results.  (JAZ) 
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AN  OVERVIEW  OF  NAEP'S  PILOT  STUDY  OF  HIGHER-ORDER 
SKILLS  ASSESSMENT  TECHNIQUES  IN  SCIENCE  AND  MATHEMATICS 


The  planning  for  NAEP's  1985-86  national  assessment  of  science  and 
mathematics  took  place  as  public  concern  focused  on  the  quality  of  elementary 
and  secondary  education  in  the  United  States.    A  number  of  prestigious  reports 
critical  of  the  schools  sparked  unprecedented  public  debate  and  calls  for 
improvement  across  the  country.    For  example.  Educating  Americans  for  the  21st 
Century,  the  ^report  of  the  National  Science  Board  Coimission  on  Precollsge 
Education  in  Mathematics,  Science  and  Technology,  stated,  "We  must  return  to 
the  basics,  but  the  basics  of  the  21st  century  are  not  only  reading,  writing 
and  arithmetic.    They  include  communication  and  higher  problem-solving  skills, 
and  scientific  and  technological  1 i teracy--the  thinking  tools  that  allow  us  to 
understand  the  technological  world  around  us.    These  new  basics  are  needed  by 
all  students..."    It  is  interesting  to  note  that  much  of  the  impetus  for  the 
national  concern  about  weak  student  performance  in  the  area  of  thinking  skills 
stemmed  from  NAEP  findings.    For  example,  NAEP  results  indicated  more 
improvement  in  the  area  of  basic  skills  in  reading,  writing,  mathematics,  and 
science  at  the  three  age  levels  than  in  making  inferences  from  printed 
material,  solving  mathematics  problems,  supporting  hypotheses,  or  interpreting 
the  meaning  of  scientific  data.    This  evidence,  however,  was  more  apparent  in 
the  areas  of  reading  and  writing  than  in  mathematics  and  science. 

Because  of  this  -national  concern,  the  Assessment  Policy  Committee,  which 
governs  NAEP  and  includes  teachers,  school  superintendents,  state  legislators, 
school  board  members,  and  representatives  from  business  and  industry,  called 
for  increased  emphasis  on  problem-solving  and  higher-order  skills  in  NAEP's 
1985-86  assessment  of  mathematics,  science,  computer  competence,  and  reading. 
To  this  end,  staff  and  consultants  set  out  to  concentrate  on  measuring 
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higher-order  thinking  skills.    However,  the  constraints  of  ^  '  -^c^ministered 
paper-pencil  technology  were  limiting.    Particularly  in  sc^  NAEP  Ktaff 

and  consultants  continually  raised  ideas  based  on  the  prn(  eo,,        -^eJ  in  the 
first  two  science  assessments,  when  NAEP  had  had  the  resourc  onduct 
assessments  of  individual  students  in  interview  situations  usinc^  .  laratus. 
It  seemed  that  it  would  be  difficult  to  gather  extensive  information  about 
higher  order  thinking  skills,  without  the  resources  to  conduct  ar  assessment 
using  science  equipment.    NAEP,  therefore,  proposed  a  focused  research  project 
to  the  National  Science  Foundation  to  investigate  higher-ordor  thinking  skills 
which  may  be  used  in  science  and  mathematics  and  to  develop  innovative 
measures  of  these  skills. 

The  goal  of  the  project  was  to  develop  and  pilot  test  a  variety  of 
innovative  measures  for  use  in  a  future  national  assessment.    During  the  first 
phase  of  the  project,  an  eleven  member  panel  of  representatives  from  the 
fields  of  mathematics,  science,  and  psychology  met  with  NAEP  staff  to  develop 
a  conceptual  framework  of  higher-order  skills  used  in  science  and  mathematics. 

The  second  phase,  task  development,  began  with  a  meeting  where  subject 
area  specialists  met  with  NAEP  staff  to  develop  prototype  exercises,  including 
"hands-on"  activities  in  which  students  are  asked  to  solve  problems,  conduct 
investigations,  or  respond  to  questions  using  actual  materials  and  equipment. 
The  development  phase  also  included  consultation  with  and  assistance  from 
members  of  the  United  Kingdom's  Assessment  of  Performance  Unit  (APU)  and  their 
science  monitoring  staff  at  Kings  College  (KQC),  London  University,  and  Leeds 
University  who  have  done  extensive  pioneering  work  in  science  assessment. 
Many  of  the  exercises  pilot  tested  in  this  project  were  adapted  from  those 
used  successfully  in  England,  Wales,  and  Northern  Ireland,  but  for  a  different 
configuration  of  age  groups  and  conceptual  framework.    N/^^P  greatly 
appreciates  their  invaluable  cooperation. 
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The  combined  work  of  the  NAEP  panels  and  staff  and  the  excellent  work  and 
guidance  of  the  APU  science  team  eventually  resulted  in  a  set  of  tasks  which 
primarily  asked  students  to  "think"  about  a  variety  of  relationships  in 
mathematics  and  science.    At  perhaps  the  easiest  end  of  the  continuum, 
students  were  asked  to  classify  and  sort  birds,  seeds,  and  vertebrae  according 
to  characteristics  of  their  own  choosing. 

At  the  next  level,  students  were  given  materials,  equipment,  and/or 
apparatus  which  exemplified  particular  mathematical  or  scientific  phenomena  or 
relationships  and  were  asked  to  observe,  infer,  and  formulate  hypotheses.  For 
example,  a  rotating  arm  was  used  to  demonstrate  that  moving  weights  from  the 
ends  toward  the  center  of  the  arm  will  change  the  speed  of  the  arm;  tubes  of 
sand  to  show  the  relationship  between  the  amount  of  sand  in  a  tube  and  the 
speed  at  which  it  would  roll  down  an  incline;  a  balance  scale  to  show  t':e 
relationship  between  weight  and  distance  from  the  fulcrum;  and  a  block 
staircase  to  exemplify  the  relationship  between  the  height  of  the  staircase 
and  the  total  number  of  blocks  required  to  build  it. 

Another  set  of  tasks  was  designed  to  measure  students'  cbility  to  detect 
patterns  in  data  sets  and  interpret  the  results.    For  example,  students  were 
asked  to  collect  and  interpret  data  about  the  effect  of  different  size  and 
shaped  wands  on  the  number  and  size  of  soap  bubbles;  to  collect  and  interpret 
data  about  the  ratio  of  green  to  red  gumballs  in  a  gumball  machine;  and  to 
interpret  data  about  participants'  scores  on  several  athletic  events. 

At  the  most  complex  level,  students  were  asked  to  design  and  conduct 
experiments  examining  a  question  posed  by  an  administrator.    These  experiments 
included:    determining  if  sugar  cubes  dissolve  faster  than  loose  sugar  and  if 
stirring  makes  a  difference;  deciding  which  fabric--pl astic  or  wool--  would 
keep  a  person  warmer  in  cold,  dry  weather;  finding  out  which  of  several 
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different  materials  would  weigh  the  most  if  their  volumes  were  equal;  and 
using  peghoards  of  different  lengths  and  widths  to  determine  how  length  and 
width  affect  the  rate  of  pendulum  swing.    Students  were  given  very  elaborate 
equipment  to  conduct  their  experiments  and  the  administrator  used  a  checklist 
to  record  student  procedures  including  the  number  and  types  of  measurements. 

Because  a  major  part  of  this  pilot  project  was  to  judge  the  feasibility 
of  more  innovative  and  complex  assessment  procedures,  NAEP  developed  as  many 
different  prototypes  of  administration  formats  as  possible.    These  can  be 
classified  into  three  major  modes  of  administration. 

Group  activities  were  administered  to  intact  classes.    These  consisted  of 
open-ended  paper  and  pencil  tasks  based  on  a  variety  of  stimuli.    In  one  case, 
the  stimuli  included  a  demonstration  of  an  experiment  by  the  exercise 
administrator  and  in  the  remaining  tasks  students  were  given  written  or 
tabular  information.    As  part  of  the  group  administrations,  students  also  were 
given  a  brief  set  of  student  background  questions  and  a  short  set  of  either 
mathematics  or  science  items  from  the  1986  national  assessment. 

Station  activities  consisted  of  "hands-on"  tasks  which  required  students 
to  work  with  a  set  of  materials  and  to  answer  questions  based  on  them.  These 
activities  were  divided  into  two  sets  of  six  tasks  for  each  grade  level. 
Groups  cf  six  students  were  given  the  tasks,  with  students  rotating  from 
activity  to  activity  every  eight  minutes.    One  task  in  each  of  the  sets  was 
administered  by  computer.    Students  received  directions  for  the  activity  via 
the  computer  and  recorded  their  answers  using  the  computer.    The  remaining 
station  activities  asked  students  to  use  apparatus  to  investigate 
relationships  and  asked  them  to  record  their  findings  using  paper  and  pencil. 
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Full  investigations  were  administered  to  individual  students.  The 
administrator  posed  the  question,  explained  the  equipment,  and  used  a 
checklist  to  mark  student  behaviors.    Students  used  the  equipment  to  conduct 
their  experiments  and  discussed  their  findings  with  the  administrators. 

Twelve  school  districts  agreed  to  participate  in  the  pilot  project,  and 
third-,  seventh-,  and  eleventh  grade  students  were  assessed  in  all  four 
regions  of  the  country.    Within  each  region  an  attempt  was  made  to  select 
schools  in  middle-income  urban,  disadvantaged  urban,  and  small  city  areas. 
Twenty-two  adriinistratiors  were  trained  during  a  one  week  period  to  administer 
the  tasks  and  code  the  observational  check  lists  for  the  full  investigations. 
The  pilot  test  was  conducted  during  April  by  teams  of  three  administrators, 
each  burdened  with  over  inO  pounds  of  equipment  and  apparatus.    The  teams 
spent  a  week  in  each  district  conducting  the  pilot  study  using  one  class  at 
each  grade  level  in  each  of  three  schools.    Almost  1,000  students  were 
assessed  in  all,  with  approximately  100-300  responses  obtained  for  each  task. 

In  the  pilot  test,  every  student  sampled  was  given  the  group  exercises. 
Approximately  three-fourths  of  the  students  also  responded  to  one  of  two  sets 
of  six  station  activities  developed  at  each  grade  level.  One-fourth 
participated  in  the  individually  administered  investigations. 

Scoring  guides  were  developed  for  all  open-ended  tasks,  and  the  student 
responses  were  categorized,  entered  into  the  computer,  and  analyzed.  The 
results  of  the  pilot  test  were  shared  with  a  panel  of  six  advisors  and  the 
tasks  were  very  well  received.    The  panelists  suggested  revisions  to  some 
tasks,  provided  advice  on  how  to  refine  the  scoring  guidelines,  and  commented 
on  the  many  ways  that  the  data  from  a  national  assessment  of  such  tasks  could 
be  analyzed.    For  example,  there  was  agreement  that  results  would  provide 
information  about  how  students  approach  such  problem-solving  tasks,  about  how 
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they  think  about  scientific  and  mathematical  relationships,  about  student 
profiles  across  tasks,  and  about  differences  in  performances  among  various 
subpopulations  of  students.    Further,  psrformance  results  could  be  related  to 
curriculum  topics  studied,  instructional  methods,  and  previous  experience. 

Summary 

NAEP  learned  many  things  from  the  pilot  study.    Developing  assessment 
tasks  based  on  equipment  and  apparatus  was  much  more  challenging  than  we  had 
anticipated.    Conceptualizing  and  predicting  the  interaction  between  the 
questions,  the  apparatus,  and  the  students  was  difficult  and  obtaining  the 
equipment  was  inordinately  time  consuming. 

Staff  additionally  had  some  difficulty  in  obtaining  school  cooperation, 
because  participation  required  three  different  areas  in  which  to  set  up 
equipment  and  involved  pulling  students  from  their  classrooms  either 
individually  or  in  small  groups.    Recruiting  and  training  administrators  to 
conduct  performance  oriented  assessments  involved  considerable  preparation. 
Also,  assembling  the  numerous  and  bulky  pieces  of  equipment  for  shipping 
across  the  country  was  extremely  complicated.    Finally,  when  developing 
scoring  guides  very  careful  thought  should  be  given  to  maximizing  what  is 
learned. 

Nevertheless,  staff  and  consultants  came  Vo  the  conclusion  that 
conducting  "hands-on"  assessment  is  feasible  and  extremely  worthwhile. 

Ry  building  on  the  experience  of  the  APU  science  team,  staff  was  able  to 
develop  and  pilot  a  very  exciting  set  of  tasks.    These  tasks  not  only  medsured 
a  variety  of  thinking  skills  relevant  to  mathematics  and  science  learning,  but 
also  covered  a  range  of  administration  techniques.    The  schools,  students,  and 
consultants  were  all  very  enthusiastic.    The  students  found  the  materials 
engaging  and  the  schools  and  consultants  were  more  than  supportive  in 
encouraging  further  use  of  these  kinds  of  tasks  in  both  instruction  and 
assessment. 


The  promise  of  the  types  of  new,  useful  information  that  could  he 
obtained  from  a  "hands-on"  national  assessment  was  perhaps  the  source  of  most 
enthusiasm.    NAEP  collected  the  pilot  study  data  to  assess  the  quality  and 
appropriateness  of  the  tasks  rather  than  levels  of  student  performance.  From 
this  perspective,  the  results  served  their  purpose.    They  indicated  that 
students  were  responding  to  the  tasks,  and  in  some  cases,  doing  quite  well. 
Also,  the  data  conformed  to  expectations  about  basic  developmental  trends  in 
thinking  skills:    1)  improved  levels  of  performance  across  the  three  grade 
levels,  and  2)  given  the  grade-appropriate  tasks,  students  appeared  to  have 
less  difficulty  with  the  sorting  and  classifying  tasks  than  with  determining 
relationships  and  conducting  reliable  experiments. 

However,  staff  and  consultants  wanted  to  know  much,  much  more.  Questions 
abounded  about  differences  in  performance  for  subpopulations,  relationships 
among  thinking  skills  across  tasks,  the  details  about  the  approaches  students 
used  and  how  those  affected  performance,  and  finally  the  relationships  between 
performance  and  previous  school  and  home  experiences.    Answers  to  these 
questions  would  [provide  invaluable  information  about  how  to  better  foster 
higher-order  thinking  skills  in  today's  classrooms. 

****************** 
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The  project  described  in  this  report— Research  on  Innovative  Higher  Order 
Skill  Assessment  Techniques  in  Mathematics  and  Science— has  been  carried  out 
by  the  National  Assessment  of  Educational  Progress  (NAEP)  with  support  from 
the  National  Science  Foundation  (NSF)  through  the  Department  of  Education's 
Office  of  Educational  Research  and  Improvement  (OERI),  Center  for  Educational 
Statistics.* 


****************** 


Part  I  of  this  report  describes  the  project.    Part  II  presents  the 
exercises  pilot -tested,  each  with  its  scoring  guide,  sample  responses, 
description  of  the  equipment  needed,  and  commentary  with  recommendations. 


*Prior  to  a  reorganization  of  the  Department  of  Education,  this  project 
was  under  the  National  Institute  of  Education  (NIE). 
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CHAPTER  1 
ASSESSMENT  FRAMEWORK 

1.  Literature  Search  and  First  Meeting  in  Washington 

The  initial  phase  of  the  NAEP  higher  order  skills  research  project  was  a 
literature  search  of  articles  and  chapters  in  the  area  of  problem  solving  and 
students'  thinking  skills.    Specific  emphasis  was  placed  on  students'  higher 
order  thinking  as  applied  to  problem  solving  in  mathematics  and  science.  The 
result  of  this  search  was  a  collection  of  readings  that  were  used  to 
familiarize  NAEP  staff  with  the  current  research  on  children's  thinking  and 
other  related  areas.    These  readings  also  were  used  to  brief  the  advisory 
panel  asked  to  help  NAEP  devise  a  conceptual  framework  of  students'  higher 
order  thinking  in  jriathematics  and  science. 

Next,  NAEP  staff  met  with  the  OERI  higher-order  skills  project  monitor, 
the  NAEP  program  officer,  and  NSF  project  sponsor  to  discuss  conceptual  and 
administrative  issues  related  to  the  project.    These  issues  included 
clarification  of  the  research  methodology  discussed  in  the  original  NAEP 
proposal,  the  specific  content  areas  to  be  covered  in  the  pilot  test,  the 
conceptual  models  of  problem  solving  which  might  be  adapted  as  a  framework  for 
students'  higher  order  thinking,  and  the  potential  candidates  for  the  first 
advisory  panel  meeting. 

2.  First  Panel  Meeting 

In  July,  1985,  an  eleven  member  panel  of  representatives  from  the  fields 
of  mathematics,  science,  and  psychology  met  with  NAEP  staff  to  develop  a 
conceptual  framework  of  thinking  skills. 

NAEP  selected  the  panelists  to  include  leaders  in  current  work  on  the 
development  of  higher-order  thinking  skills  in  science  and  mathematics.  They 
are  listed  below. 
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Louis  Amijo 
Audrey  Champagne 

Randall  Charles 
Cindy  Hrebar 
Jeremy  K11 pat rick 
Richard  Mayer 
James  Minstrell 
Howard  R,  Pol  Ho 
James  Robinson 
Beta  Schofleld 
Gerald  Wheeler 


Naval  Post  Graduate  School,  Monterey,  CA 
American  Association  for  the  Advancement  of 
Science,  Washington,  DC 
Illinois  State  University,  Normal,  IL 
Jefferson  County  Schools,  Lakewood,  CO 
University  of  Georgia,  Athens,  GA 
University  of  California,  Santa  Barbara,  CA 
Mercer  Island  High  School,  Mercer  Island,  WA 
University  of  Tennessee,  Knoxvllle,  TN 
Boulder  Valley  Schools,  Boulder,  CO 
Kings  College,  London,  England 


Montana  State  University,  Bozeman,  MT 
Additional  participants  Included  Gerald  Kulm,  the  program  officer  at 
OERI;  Richard  Berry,  the  program  director  at  NSF;  and  the  project  staff, 
Fran  Blumberg,  Staff  Associate,  NAEP;  Marion  Epstein,  Project  Coordinator, 
NAEP;  Walter  MacDonald,  Science  Examiner,  ETS;  and  Ina  Mullis,  Associate 
Director,  NAEP. 

Several  panel  members  gave  brief  presentations  about  their  experiences 
and  research  in  defining  and  assessing  higher-order  thinking. 
Seta  Schofleld 's  description  of  the  pioneering  work  done  by  the  Assessment 
Performance  Unit  (APU)  science  team  in  the  United  Kingdom  was  of  special 
Interest.    This  unit  is  located  in  and  funded  by  the  Department  of  Education 
and  Science,    Mrs,  Schofleld  presented  the  framework  the  APU  science  teams 
commissioned  for  the  work  by  the  unit  and  described  the  APU  exercises  which 
asked  students  to  conduct  investigations. 
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James  Minstrel!  presented  a  detailed  outline  of  rational,  creative  and 
critical  thinking  skills  that  had  been  developed  as  part  of  the  Washington 
State  Guidelines  for  Science  Education.    Randall  Charles  and  Richard  Mayer 
presented  work  they  had  done  related  to  mathematics  education. 

After  much  additional  discussion,  the  consultants  developed  a 
very  interactive  and  inclusive  framework  based  on  the  premise  that,  at  the 
most  general  level,  higher  order  thinking  skills  are  used  to  formulate  a 
question,  design  and  perform  an  analytic  procedure,  and  reach  a  conclusion  to 
a  problem.    Further,  such  thinking  was  considered  to  be  continuously 
self-monitored  and  evaluated  as  it  occurs  during  the  course  of  working  through 
a  problem  or  situation.    Finally,  subject-matter  knowledge,  beliefs,  and 
values  also  impact  upon  how  effectively  an  individual  employs  thinking  skills 
in  a  particular  situation.    The  model,  as  developed,  is  shown  in  Figure  1  and 
the  description  prepared  by  the  committee  is  presented  below. 

3.    The  Framework 
Introduction 

The  panel  organized  the  framework  for  higher-order  thinking  into  aspects, 
which  interact  with  the  monitoring  processes  of  generating  and  evaluating. 
The  aspects  are  "snapshots"  of  the  dynamic  process  of  investigation  or  problem 
solving.    Each  is  a  shorthand  label  for  a  group  of  activities  that  the  panel 
felt  may  be  involved  in  higher  order  thinking  in  various  situations  and 
contexts. 

The  Aspects 

The  aspects  of  the  model  (shown  in  circles)  are  what  is  "done"  in  science 
and  mathematics.    They  are  not  independent  but  collectively  comprise  the 
critical  parts  of  the  complex  network  of  thinking  skills  in  science  and 
mathematics.    Operating  within  each  of  the  aspects  are  the  thinking  processes 
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of  generating  and  evaluat1ng/mon1tor1ng  which  also  are  operating  In  the 
context  of  science  and  mathematics  knowledge,  beliefs,  and  the  environment. 
The  environment  may  Include  external  parameters  such  as  recent  experiences, 
working  conditions,  and  testing  situations,  as  well  as  internal  parameters 
such  as  personality  characteristics  and  Interpersonal  reactions.  These 
environmental  parameters  also  may  affect  Interest,  motivation,  attitudes. 
Involvement,  perserverance,  and  cooperation. 

Understanding  the  Problem/Situation  refers  to  Initial  understanding. 
Including  Initial  perception  of  the  data,  linguistic  comprehension  of  the 
problem  or  situation,  translation  of  the  problem  Into  other  formats,  and 
identification  of  possible  outcomes.    For  example,  the  initial  perception  of 
the  data  may  Include  understanding  which  data  are  relevant  to  the  problem  or 
situation.    The  linguistic  comprehension  of  the  problem  may  include  the 
ability  to  communicate  the  nature  of  the  problem  to  others.    The  translation 
of  the  problem  may  include  the  ability  to  look  at  and  understand  the  problem 
in  a  different  context.    The  Identification  of  possible  outcomes  may  Include  a 
perception  of  what  the  problem  or  situation  mandates  as  well  as  an  ^^a  priori" 
estimate  of  the  answer(s). 

Develop  a  Plan  or  Investigation  consists  of  looking  for  patterns, 
selecting  and  operational izing  Independent  and  dependent  variables, 
identifying  appropriate  strategies,  selecting  appropriate  subgoals,  designing 
data  collection  and  organization,  developing  models,  drawing  pictures, 
choosing  appropriate  apparatus,  and  other  similar  skills. 

Looking  for  patterns  may  Include  an  Initial  scrutiny  for  trends  or 
indication  of  relationships  which  may  suggest  a  specific  approach  to 
investigation.    Selecting  and  operational izing  variables  also  are  necessary 
components  of  designing  and  planning  an  investigation.    Choosing  appropriate 
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subgoals  may  be  needed  in  an  investigation  in  which  there  are  many 
intermediate  results  that  must  be  gained  before  the  initial  question  is 
answered  or  problem  is  solved.    Designing  data  collection  and  organization  may 
Include  the  planning  of  sampling  locations,  sampling  frequency,  and  record 
keeping.    The  development  of  models  and  drawing  pictures  are  abilities  that 
may  make  the  progress  through  a  problem  or  investigation  more  efficient. 

Implementing  a  Plan  refers  to  the  actual  performance  or  "doing"  of 
science  or  mathematics.    It  should  be  remembered  that  there  may  not  be  sharp 
boundaries  between  these  aspects,  particularly  with  developing  and 
implementing  a  plan.    For  example,  when  carrying  out  an  investigation,  a 
perceived  limitation  in  the  plan  may  warrant  redeveloping  the  plan.  In 
addition,  it  is  possible  that  while  developing  the  plan,  the  need  may  be 
perceive<f  for  a  better  understanding  of  the  problem  or  its  reformulation. 
This  "learning  while  doing"  situation  is  an  important  feature  of  higher  order 
thinking  in  science  and  mathematics. 

Reaching  a  Goal .  dependent  upon  the  original  problem  or  situation,  may 
include  such  activities  as;  determining  the  answer,  drawing  conclusions,  and 
reaching  a  decision.    The  ability  to  determine  the  answer  may  include  the 
discarding  of  extraneous  solutions  or  the  recognition  of  multiple  solutions 
when  they  exist.    Drawing  conclusions  may  include  the  ability  to  interpret 
results,  recognize  their  implications,  and  knowing  when  the  desired  outcomes 
have  been  achieved.    This  is  similar  to  the  ability  to  recognize  when  adequate 
Information  has  been  obtained  when  reaching  a  decision  was  the  initial  goal. 

Assessing  is  an  overall  evaluation  of  the  investigation  performance  or 
problem-solving  rather  than  the  ongoing  evaluation  and  monitoring.  Inherent 
in  this  aspect  are  many  skills  such  as  reflecting,  interpreting  results, 
generalizing,  anticipating,  and  reporting  the  findings. 
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Reflecting  includes  looking  back  on  the  entire  body  of  work  and  checking. 
The  checking  component  of  reflecting  is  the  verification  of  the  precise 
execution  of  the  original  plan  and  may  include  repeating  some  or  all  steps  of 
the  problem  or  investigation,  or  a  review  of  the  process  or  calculations. 
Lroking  back  may  include  assessing  the  reasonableness  of  the  results  and 
determining  whether  the  original  problem  or  situation  has  really  been 
answered.    Interpreting  results  may  include  noting  whether  there  have  been  any 
unexpected  and  valuable  findings,  and  determining  the  significance  of  the 
results.    Generalizing  may  include  the  ability  to  recognize  patterns  in  data 
or  results,  to  apply  them  to  more  complex  or  different  situations,  and  to 
formulate  general  theories  from  specific  results.    Anticipating,  based  on  the 
results  or  generalizations  from  results,  may  include  looking  ahead, 
predicting,  and  recognizing  implications  for  future  investigations. 

Formulating  Problems  or  Goals  includes  detailed,  precise  observations  of 
facts  or  results  and  the  initial  formulation  of  hypotheses.    For  example, 
identification  of  a  pattern  or  the  prediction  done  v/hile  assessing  may  lead  to 
the  formulation  of  a  new  hypothesis  for  investigation.    Raw  data  or  a  set  of 
personal  observations  also  may  lead  to  the  formulation  of  a  problem  or  the 
setting  of  a  goal  without  being  influenced  by  a  prior  investigation. 

Again,  the  entire  process  is  dynamic  and  the  distinctions  between  the 
aspects  are  fuzzy.    Reaching  a  goal,  assessing,  and  formulating  goals  will 
often  blend  with  each  other  and  problem  solving  or  investigations  may  require 
repeated  iterations.    Operating  within  each  of  these  aspects  are  the 
generating  and  evaluating/monitoring  processes.    A  description  of  each  of 
these  processes  is  presented  next. 
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The  Generating  Processes 

Central  to  and  permeating  all  aspects  of  higher  order  thinking  is  the 
ability  of  the  individual  to  produce  novel  ideas,  situations,  approaches,  and 
possibilities. 

There  are  many  ways  in  which  this  may  happen;  historically  these  ways 
have  bepi  split  into  two  major  divisions  -  analytic  and  Intuitive,  Included 
under  the  analytic  category  may  be  inductive  and  deductive  reasoning, 
hypothesis  Formation,  formal  modeling,  correlating  variables,  inferring 
relationships,  and  synthesizing  observations  into  concepts.    Included  in  the 
intuitive  category  may  be  the  use  of  analogy,  metaphor,  and  other  non-literal 
devices;  inexact,  qualitative  approximation;  and  imagery  (many  models 
originate  from  images). 

In  actual  practice,  the  distinction  between  the  modes  are  nebulous  and 
the  individual  may  operate  in  both  modes  simultaneously.    For  example, 
discerning  a  pattern  or  generalizing  observations  into  new  concepts  may 
include  both  intuitive  and  more  formal,  analytical  techniques. 

The  Evaluating  Processes 

Evaluating  and  monitoring  are  the  quality  control  operations  for  higher 
order  cognitive  processes.    The  evaluating/monitoring  processes  function  as 
sentinels  that  check  progress  through  a  plan.    Have  I  executed  all  the 
elements  of  my  plan?    How  do  I  determine  when  it  makes  sense  to  give  up  on  a 
problem  or  to  go  to  get  help  from  someone  else?    When  do  I  need  to  get  the 
opinion  of  a  peer  or  teacher  on  my  progress? 
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Evaluating/monitoring  also  implies  the  existence  of  a  standard  against 
which  each  product  of  the  processes  of  problem  solving  is  matched.  Standards 
are  internal  and  external.    External  standards  for  scientific  and  mathematical 
problem  solving  are  discipline  specific.    They  are  derived  from  subject  areas 
and,  thus,  there  is  a  need  for  a  Strong  base  of  organized  content  knowledge. 
Internal  standards  are  set  by  the  individual's  beliefs. 

Therefore,  it  is  with  the  processes  of  evaluating/monitoring  that  the 
aspects  as  well  as  the  generating  processes  of  higher  order  thinking  are 
controlled  and  directed.    For  example,  the  interaction  of  evaluating/ 
monitoring  with  the  generating  process  is  extremely  important  in  winnowing 
ideas  that  are  too  fanciful  and  the  interaction  of  evaluating/monitoring  with 
the  various  aspects  is  also  important  in  winnowing  unrealistic  activities. 
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CHAPTER  2 
EXERCISE  DEVELOPMENT 

1.    Second  Panel  Meeting 

A  seven  person  panel  met  to  develop  prototype  tasks  and  to  consider 
potential  assessment  strategies,  methods  of  administration,  and  how  the 
exercises  should  be  scored.    To  provide  continuity,  four  members  of  tne 
original  panel  participated  in  the  meeting— Jeremy  Kilpatrick,  Richard  Mayer, 
James  Minstrell,  and  James  Robinson.    To  provide  additional  perspectives,  NAEP 
also  invited  Roberta  Flexer,  University  of  Colorado,  Boulder,  Colorado; 
Josephine  Davis,  Albany  State  College,  Albany,  Georgia;  and  Patricia  Murphy, 
Deputy  Director  of  the  APU  science  team  at  King's  College,  London,  England. 
(The  NAEP  staff  and  the  representatives  from  OERI  and  NSF  were  the  same  as  for 
the  first  panel  meeting.) 

Panel  members  shared  ideas  on  innovative  activities  for  third-,  seventh-, 
and  eleventh-grade  students,  including  those  which  would  require  students  to 
plan  and  carry  out  full  problem  solving  investigations.    Many  useful  Ideas  for 
assessment  activities  using  contexts  in  mathematics  and  science  were 
suggested. 

Patricia  Murphy  contributed  many  significant  comments,  caveats,  and 
suggestions  based  on  her  extensive  experience  with  the  APU  science  assessment 
over  a  number  of  years.    The  points  she  made  which  had  a  major  impact  on 
exercise  development  included: 
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In  developing  assessment  exercises  in  mathematics  and  science 
contexts,  it  is  necessary  to  take  into  consideration  external 
influences  which  may  create  gender  effects,  influence  motivation,  or 
affect  students'  willingness  to  complete  a  given  task.    For  example, 
APU  found  that  female-stereotyped  activities,  such  as  determining  the 
most  effective  flooring  for  a  kitchen,  did  not  engage  some  of  the  boys 
in  their  sample. 

Because  students'  views  of  what  is  or  is  not  "science"  are  shaped  by 
their  experiences,  they  may  reformulate  a  given  assessment  task  to  fit 
their  perception  of  science  and  proceed  to  solve  the  problem  in  ways 
incompatible  with  those  intended  by  the  assessor.    This  can  have 
serious  implications  for  ^.he  scoring,  analyzing,  and  reporting  of 
student  performance.    (The  APU  science  teams  chose  to  use  open  items 
to  derive  a  rich  source  of  children's  perceptions  of,  and  reactions 
to,  science  tasks.    Categories  of  response  were  developed  to  deal  with 
the  data  obtained  from  these  items.    The  categories  included  typical 
hierarchies  of  response  but  in  addition  included  alternative  but 
equally  adequate  responses  as  well  as  a  variety  of  error  responses. 
Categories  of  response  with  these  attributes  are  not  readily 
scaleable.    Consequently,  this  type  of  analysis  is  incompatible  with  a 
goal  to  report  results  in  a  predetermined  way.    If  this  is  the 
priority,  then  uniformity  in  students'  conceptualization  of  the 
problem  is  needed  to  analyze  and  report  results  in  a  standard  way 
across  the  sample  of  respondents,  and  the  goal,  when  developing 
exercises,  should  be  to  use  contexts  which  are  common  enough  to  be 
understandable  yet  unfamiliar  to  the  extent  that  students  do  not  have 
a  learned  algorithm  available  to  solve  the  problem.) 
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0   APU  has  found  that  students  are  better  at  actually  performing  an 
investigation  to  solve  a  problem  than  they  are  at  explaining, 
verbally,  the  operations  involved  in  an  investigation.  Accordingly, 
there  should  be  awareness  when  designing  an  assessment  that  students' 
performance  may  be  better  on  less  structured  "hands-on"  assessment 
methods  than  on  more  structured  paper  and  pencil  and  interview 
methods. 

0   Whenever  possible,  the  method  of  administration  of  the  activities 
should  be  consistent  across  all  age  groups  to  permit  better  assessment 
of  developmental  change  in  problem-solving  and  to  get  a  better 
perspective  on  which  types  of  activities  are  or  are  not  suitable  for  a 
given  age  group, 

A  major  issue  discussed  throughout  the  meeting  Kas  the  confounding  of 
subject-matter  background  knowledge  with  the  ability  to  solve  a  given  problem. 
Consequently,  in  developing  tasks,  staff  and  consultants  decided  to  try  to 
minimize  the  potential  effect  of  prior  knowledge  on  successful  performance. 

The  panel  split  into  two  groups  for  exercise  development,  one  with  an 
emphasis  on  mathematics the  other  on  science.    Each  group  was  responsible  for 
developing  ideas  for  innovative  exercises  within  their  area  of  emphasis  as 
well  as  some  that  integrated  or  incorporated  concepts  from  both  areas.    At  the 
conclusion  of  the  meeting,  the  ideas  for  assessment  activities  developed  were 
reviewed  and  evaluated  with  particular  attention  given  to  administrative 
feasibility,  administrator  training,  and  equipment  needed. 

All  those  participating  in  this  development  process  were  impressed  by  the 
difficulties  involved  and  were  concerned  about  the  short  time  frame  for  the 
project.    It  was  agreed  that  it  would  be  desirable  to  try  and  benefit  more 
fully  from  the  higher  order  skills  activities  and  administration  procedures 
developed  by  the  APU  science  team, 
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2.    The  Assessment  Performance  Unit  (APU):  Science 

As  stated  previously,  NAEP  had  invited  a  representative  from  the 
APU  science  monitoring  team  to  each  of  the  planning  conferences.    From  the 
descriptions  of  the  wc^^  done  by  the  APU  provided  by  these  representatives  and 
previous  visits  between  NAEP  and  APU  staff  members,  it  became  apparent  that 
the  project  planned  by  NAEP  had  aspects  in  common  with  parts  of  the  APU 
scienct:  assessment. 

As  shown  below  in  Table  1,  which  presents  the  category  descriptions  for 
the  APU  Science  Assessment  Framework,  three  of  the  categories  are  measured 
using  "hands-on"  or  practical  assessment  techniques.    These  three  are: 
Category  2--Use  of  apparatus  and  measuring  instruments.  Category 
3 — Observation,  and  Category  6--Performance  of  investigations. 

Since  the  APU  had  seven  years  experience  (n  developing  and  assessing 
performance  tasks  similar  to  those  envisioned  by  the  NAEP  staff  and 
consultants,  a  visit  to  the  APU  to  see  their  assessment  materials  seemed  very 
appropriate.    The  staff  of  the  APU  was  more  than  gracious  in  preparing  for  our 
visit,  having  set  up  a  basketball  gymnasium  full  of  their  performance  tasks. 
On  display,  were  the  questions,  administration  directions  when  appropriate, 
complete  sets  of  the  apparatus,  and  scoring  guides.    NAEP  staff  were  left  to 
"self-administer"  the  many  hands-on  tasks  and  the  APU  staff  were  available  for 
questions. 
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Table  1. 

The  APU  Science  Assessment  Framework* 
The  Categories  of  Science  Performance 

Category 

Sub-categories 

Mode  of 
Testing 

1  Use  of  graphical 
and  symbolic 
representation 

-  reading  information  from  graphs, 
tables  and  charts 

-  representing  information  as  graphs, 
tables  and  charts 

written 
tests 

2  Use  of  apparatus 
and  measuring 
instruments 

-  using  measuring  instruments 

-  estimating  physical  quantities 

-  following  instructions  for 
practical  work 

practical 
tests 

3  Observation 

-  making  and  interpreting 
observations 

practical 
tests 

4  Interpretation 
and 

application 

-  I    interpreting  presented  information 

-  n  applying:    biology  concepts 

physics  concepts 
chemistry  concepts 

written 
tests 

5  Planning  of 
investigations 

-  planning  parts  of  investigations 

-  planning  entire  investigations 

written 
tests 

6  Performance  of 
investigations 

-  performing  entire  investigations 

indi vidual- 

practical 

tests 

♦Science  in  Schools,  Ages  13  and  15:  Report  No.  3,  Assessment  of 
Performance  Unit,  Department  of  Education  and  Science,  ®.  Crown 
copyright  1985. 
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NAEP  staff  were  very  experienced  in  test  development,  yet  in  the  week 
spent  working  through  the  APU  materials,  the  overwhelming  nature  of  developing 
and  assessing  materials  of  such  quality  and  complexity  became  clear. 
It  became  apparent  that  NAEP  was  not  going  to  be  able  to  develop  more  than  a 
relatively  small  portion  of  such  tasks  in  the  short  time  proposed  for  the 
higher  order  skills  project.    Designing  the  apparatus  alone  would  be  a 
monumental  task.    Thus,  NAEP  entered  into  an  arrangement  for  further  support 
from  the  APU  for  both  consultant  help  and  use  of  some  of  their  copyrighted 
materials.    This  arrangement  enabled  NAEP  to  benefit  from  some  already 
validated  materials  for  use  in  piloting  these  tasks  in  American  schools,  and 
to  focus  on  developing  new  exercises  such  as  those  involving  computers  and 
those  assessing  higher  order  skills  in  mathematical  contexts. 

Some  difficulties  did  arise  because  of  a  certain  dissonance  between  the 
goals  of  the  APU  Science  Assessment  and  NAEP's  higher-order  skills  assessment 
project.    First,  the  APU  routinely  conducts  their  science  assessment  based  on 
all  six  categories  shown  above  in  an  integrated  way.    Unfortunately,  because 
of  lack  of  resources,  NAEP  has  not  been  able  to  conduct  a  science  assessment 
that  included  hands-on  work  with  apparatus  since  the  second  assessment 
conducted  in  1972-73.    NAEP  simply  did  not  have  the  resources  to  include  these 
types  of  items  in  the  regularly  scheduled  science  assessment  conducted  in 
1985-86  and  was  working  on  such  tasks  separately,  rather  than  in  the  context 
of  the  full  science  assessment.    In  fact,  this  omission  in  our  more  recent 
science  assessments  was  an  impetus  to  the  project  proposal.    Second,  NAEP  had 
received  a  mandate  from  its  governing  body,  the  Assessment  Policy  Committee, 
to  focus  on  the  assessment  of  higher-order  skills  in  both  the  1935-86 
mathematics  and  science  assessments.    This  had  proved  somewhat  difficult  using 
paper  and  pencil  technology  within  the  restraints  of  the  overall  research 
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design  and  resource  limitations.    Tie  APU  science  team  was  using  hands-on 
performance  tasks  to  measure  specific  science  skills  as  described  in  their 
assessment  framework.    For  NAEP,  the  emphasis  needed  to  be  on  the  thinking 
skills  involved  as  opposed  to  science  content,  although  the  two  are  not 
independent. 

However,  it  should  be  noted  that  both  the  NAEP  and  APU  science  assessment 
frameworks  emphasize  skills  as  well  as  content.    A  spectrum  of  skills,  from 
basic  to  higher  order  ones,  is  reflected  in  the  APU  science  categories  1  to  6 
(Table  1).    This  spectrum  of  skills  forms  the  central  theme  of  the  whole 
national  monitoring  program  in  science  in  the  United  Kingdom.    In  the  APU 
science  assessment  where  the  emphasis  in  the  tasks  is  on  the  assessment  of 
skills,  content  is  used  as  a  vehicle  for  their  deployment.    There  is  no 
requirement  in  these  tasks  for  the  pupils  to  explain  the  influence  of  the 
content.    The  assessment  of  children's  understanding  of  scientific  knowledge 
is  done  in  Category  4ii  of  the  Assessment  Framework  (Table  1).    In  this 
category,  pupils  have  to  recall,  apply  and  explain  their  conceptual 
understanding. 

After  further  discussion,  it  was  resolved  that  NAEP  could  revise  and 
modify  materials  developed  by  the  APU  for  their  Category  3— Observation,  but 
that  ^AEP  would  try  to  replicate  any  Category  6— Performance  of  Investigations 
materials  as  faithfully  as  possible  within  the  constraints  of  our  time  and 
resources.    NAEP  is  grateful  for  the  continuing  support  of  the  APU  science 
monitoring  team  throughout  the  many  phases  of  this  pilot  project. 
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3.    Internal  Development 

After  the  exercise  development  panel  meeting,  staff  sent  copies  of  the 
framework  to  mathematics  and  science  examiners  within  ETS  and  requested 
additional  suggestions  for  innovative  tasks  to  assess  higher-order  skills  in 
these  disciplines.    At  the  same  time,  staff  began  intensive  review  of  the 
panel's  suggestions  for  activities  and  of  the  more  fully  specified  tasks. 

It  was  decided  that  the  pilot  testing  should  include  three  types  of 
administrations  -  paper  and  pencil  tasks  that  could  be  administered  in  a  group 
setting;  short,  self-administered  "hands-on"  tasks  with  several  activities 
set-up  at  stations  in  a  room  and  students  conducting  the  activities  on  a 
rotating  basis;  and  full  investigations  administered  to  individual  students. 
Although  the  panel  had  been  especially  interested  in  the  full  investigations, 
the  staff  recognized  that  the  project  could  not  afford  testing  more  than  two 
or  three  full  investigations  at  each  grade.    Therefore,  some  of  the  tasks 
developed  by  the  panel  were  converted  to  station  exercises.    Some  additional 
exercises  were  developed  by  the  staff  and  tasks  proposed  by  the  panel  were 
fleshed  cut  and  refined.    In  some  cases,  tasks  had  to  be  discarded  because  the 
equipment  required  would  be  too  complex. 

The  project  staff  considered  all  the  available  tasks,  including  those 
newly  developed  and  a  selected  subset  of  those  developed  by  the  APU  science 
team.    They  identified  those  newly  developed  exercises  that  could  be  converted 
to  group  administration,  selected  the  full  investigations  for  individual 
administration,  and  made  an  initial  selection  of  more  than  enough  station 
activities  for  two  sets  of  six  stations  for  each  grade. 

A  concentrated  period  of  reviewing  and  revising  the  selected  tasks 
followed.    Given  the  time  frame  for  the  project j  there  would  have  been 
difficulties  in  meeting  the  schedule  for  federal  agency  reviews  of  the  tasks, 
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printing  the  booklets,  training  administrators,  and  carrying  out  the 
pilot  testing  without  the  invaluable  cooperation  of  the  APU  science  team.  The 
ideas  for  more  than  half  the  tasks  were  taken  from  exercises  developed  by  the 
APU  for  their  national  monitoring  of  science  performance.    However,  many  of 
these  exercises  were  substantially  changed  to  function  with  NAEP's  very 
different  framework  and  it  should  be  noted  that  the  APU  is  not  responsible  for 
the  altered  use  of  their  ideas  in  this  project.    Five  group  exercises,  six 
station  activities,  and  one  full  investigation  were  completely  developed  by 
NAEP  staff. 

The  exercise  development  panel  had  recommended  administering  some  of  the 
mathematical  exercises  by  computer.    They  suggested  that  students  could 
estimate  the  ratio  of  red  to  green  gumballs  based  on  repeated  drawings  from  a 
gumball  machine  and  that  students  could  work  number  games  appropriate  to  their 
age  level  similar  to  the  mathematical  game  of  "Nim."    Scripts  were  written  for 
the  two  exercises  at  grade  3  and  owo  similar  tasks  for  grades  7  and  11, 
Programs  were  written  for  Apple  II  series  computers  because  more  schools  have 
these  than  any  other  type  of  computer.    NAEP  and  ETS  staff  set  the 
specifications  and  wrote  the  BASIC  computer  coding  for  these  programs. 
Programs  were  reviewed,  tried  out,  and  further  revised. 

4.    The  Tasks  for  the  Pilot  Study 

The  combined  work  of  the  NAEP  panels,  ETS  staff,  and  the  excellent 
materials  and  guidance  provided  by  the  APU  science  team  eventually  led  the 
project  staff  to  select  a  set  of  tasks  which  primarily  asked  students  to 
"think"  about  a  variety  of  relationships  in  mathematics  and  science.  At 
perhaps  the  least  difficult  end  of  the  continuum,  the  tasks  asked  students  to 
classify  and  sort  birds,  seeds,  and  vertebrae  according  to  characteristics  of 
their  own  choosing.    While  biologists  have  given  such  schemes  much  thought  and 
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it  was  hoped  students  might  think  like  biologists,  the  goal  was  to  assess 
flexibility  and  an  ability  to  think  of  alternative  ways  of  sorting  or 
classifying. 

At  the  next  level,  the  tasks  were  based  on  materials,  equipment,  and/or 
apparatus  which  exemplified  particular  known  mathematical  or  scientific 
phenomena  or  relationships*    The  students  were  asked  to  work  with  the 
equipment  and  observe,  infer,  and  formulate  hypotheses.    For  example,  the 
whirlybird  apparatus  was  used  to  demonstrate  that  moving  weiqhts  from  the  ends 
toward  the  center  of  the  arm  will  change  the  speed  of  the  whirlybird  arm; 
tubes  with  sand  were  used  to  show  the  relationship  between  the  amount  of  sand 
in  a  tube  and  the  speed  at  which  it  would  roll  down  an  incline;  a  "wig-wag" 
apparatus  to  show  the  relationship  between  the  amount  of  weight  placed  in  a 
flexible  tray  and  the  speed  and  amplitude  of  its  swing;  and  a  double  staircase 
of  blocks  to  exemplify  the  relationship  between  the  height  of  the  staircase 
and  the  total  number  of  blocks  required  to  build  it. 

Another  set  of  tasks  was  designed  to  measure  students'  ability  to  detect 
patterns  in  data  sets  and  interpret  the  results.    For  example,  students  were 
asked  to  collect  and  interpret  data  about  the  effect  of  different  size  and 
shaped  wands  on  the  number  and  size  of  soap  bubbles;  to  collect  and  interpret 
data  about  the  ratio  of  green  to  red  gumballs  in  a  gumball  machine;  and  to 
interpret  data  about  participants'  scores  on  several  athletic  events. 

Finally,  individual  students  were  asked  to  conduct  full  investigations. 
In  Sugar  Cubes  they  were  asked  to  determine  if  sugar  cubes  dissolve  faster 
than  loose  sugar  and  if  stirring  makes  a  difference.    Survival  required  them 
to  determine  which  fabric — plastic  or  wool — would  keep  a  person  warmer  in 
cold,  dry  we£ther.    Density  asked  them  to  determine  which  of  three  materials 
of  different  size  and  shape  would  weigh  the  most  if  their  volumes  were  equal. 
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In  Pegboards,  students  were  asked  to  use  boards  of  different  lengths  and 
widths  to  determine  how  length  and  width  affect  the  rate  of  pendulum  swing. 
For  these  tasks,  observers  marked  student  behaviors  on  a  checklist. 

The  tasks  by  thinking  skill  and  administration  type  are  listed  in 
Table  2.    All  the  pilot-tested  tasks  appear  in  Part  II  of  this  report  exactly 
as  they  were  presented  to  the  students,  with  their  scoring  guides,  sample 
responses,  description  of  the  apparatus,  summary  comments,  and  pi  lot -test 
data.    In  addition,  a  brief  set  of  student  background  questions  was  devised  so 
that  the  pilot-test  sample  could  be  described.    These,  along  with  the  results,, 
are  included  in  Appendix  B.    For  linking  and  research  purposes,  at  each  grade 
level  a  small  set  of  about  20  items  each  of  science  and  mathematics  exercises 
from  NAEP's  spring  1986  national  assessment  was  selected  to  be  part  of  the 
pilot  administrations.    (These  items  are  secure.) 

5.    Obtaining  the  Apparatus  and  Equipment 

The  majority  of  the  exercises  developed  for  the  project  were  "hands-on" 
and  required  the  use  of  apparatus  and  equipment.    These  materials  were  either 
purchased  from  supply  houses  or  devised  by  NAEP  and  ETS  staff. 

During  the  October  visit  to  the  APU  science  team  at  Kings  College  (KQC), 
London,  NAEP  staff  learned  that  the  APU  Science  team  worked  with  Philip  Harris 
Ltd.  and  this  company  was  contracted  to  assemble,  package,  and  ship  selected 
materials  based  on  APU  specifications.  The  equipment  that  arrived  at  NAEP 
early  in  March  included  multiple  sets  of  each  of  the  following:    Whirlybird  (a 
group  exercise);  Sand  and  Tubes,  Rolling  Funnels,  Wig-Wag,  Water-on-Brick . 
lyt^bles ,  Tubes  and  Capillarity,  Conductivity,  Magnet  and  Compass,  and  Sugar 
Cubes  (station  exercises);  Sugar  Cubes,  Pegboards,  and  Survival  (full 
investigation  exercises).    (The  apparatus  for  Sugar  Cubes  as  a  station 
exercise  for  grade  7  is  the  same  as  for  the  full  investigation  for  grade  3.) 
Pictures  of  the  apparatus  are  included  in  Part  II  of  this  report. 


Table  2, 


NAEP  Pilot  Study  Thinking/Inferencing  Skills  by  Administration  Type 


Administration  Types 

Thinking/Inferencing 

^l^il^s  Group  Station  Individual 

Sorting,  Classifying  Birds  (classify)  (3) 

(distinguishing  Birds  (sort)  (3) 

patterns  within  a  Seeds  (classify)  (3,7,11) 

single  class  of  items)  Vertebrae  (sort)  (11) 

SeedL  (sort)  (7) 

Observing,  Inferencing,       yhirlybird  (3,7)  Sand  and  Tubes  (3,7,11)  ' 

and  Formulating  Number  Relationships  (7,11)     Rolling  Funnels  (3,7,11)  ^ 

Hypotheses  based  Restaurant  (7.11)  Circle  Game  (3)  ' 

on  mathematical  and  Number  Game  (7,il) 

scientific  principles  Wig-Wag  (3,7) 

(inferring  relationships  Water  on  Brick  (3) 

between  an  independent  Balance  Scale  (7,11) 

and  dependent  variable)  Double  Staircase  (3,7,11) 

Tubes  and  Capillarity  (7,11) 
Conductivity  (11) 

Interpreting  data        ,    Hair  Color  (3)  Guniball  Game  (3,7,11) 

(inferring  patterns        Triathlon  (3,7,11)  Bubbles  (3,7,11) 

i"  results)  Magnet  and  Compass  (11) 


Designing  and  Conducting      Heart  Rate  and  Exercise  (11)    Sugar  Cubes  (7)  Sugar  Cubes  (3) 

an  experiment  (designing  only)  Hagnets  (3)  Pegboards  (3,7,11) 

Survival  (7,11) 
Density  (7,11) 
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NAEP  and  ETS  staff  devised  the  materials  and  apparatus  for  the  other 
station  exercises:  Gumballs,  Circle  Game,  Numbers  Game,  Balance  Scale,  Double 
Staircase,  Magnets,  Birds  (classify).  Birds  (sort).  Seeds  (classify).  Seeds 
(sort),  and  Vertebrae,  and  for  the  other  full  investigation  exercise.  Density, 

Gumballs,  Circle  Game,  and  Numbers  Game  were  the  station  exercises 
developed  for  self-administration  using  an  Apple  II  computer.  Twelve 
operational  and  12  back-up  disks  were  prepared  for  each  program  at  each  grade 
level • 

For  Balance  Scale,  the  scale  was  designed  and  made  at  ETS.    The  unknown 
weight  was  a  plastic  film  canister  filled  with  gravel.    For  Double  Staircase, 
stock  lumber  was  purchased,  hundreds  of  wooden  blocks  were  cut,  and  double 
staircases  were  assembled. 

For  Magnets,  disk  magnets  were  purchased  at  Edmund  Scientific  Co, 
Barrington,  NJ.    Eight  disk  magnets  were  glued  together  to  make  strong  magnets 
whereas  non-magnetic  washers  were  sandwiched  betweec.  two  disk  magnets  to  make 
weak  magnets.    Both  types  of  magnets  were  dipped  in  paint  to  give  a  uniform 
external  appearance. 

For  Birds  (sort),  small,  colored  drawings  of  seven  species  of  small, 
perching  birds  were  purchased  and  mounted  on  cardboard.    For  Birds  (classify), 
colored  photographs  of  four  species  of  waterfowl  were  acquired  and  mounted  on 
cardboard.    The  seeds  selected  for  Seeds  (sort)  and  Seeds  (classify)  included 
caraway,  cumin,  fennel,  black  peppercorns,  all  spice,  white  peppercorns, 
millet,  yellow  mustard,  and  fenugreek.    All  of  the  seeds  were  purchased  at  a 
local  food  store. 

For  Vertebrae,  four  cervical,  three  thoracic,  and  four  lumbar  vertebrae 
comprised  each  set  of  bones.  The  bones  were  ordered  from  Connecticut  Valley 
Biological  Supply  Co.  in  Holyoke,  MA. 
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Density  required  three  blocks  of  different  shapes  and  sizes,  made  of 
woods  with  significantly  different  densities.    NAEP  staff  acquired  the  woods, 
cut  them  to  size  and  shape  and  painted  them  for  external  uniformity.    A  scale 
was  purchased  from  Edmund  Scientific  for  weighing  blocks.    Rulers  and  solar 
calculators  were  purchased  for  measuring  volumes  and  calculating  results. 

Utility  kits  and  ancillary  materials  were  provided  for  the  administrators 
to  assess,  to  repair,  and  to  refurbish  all  exercises.    All  the  equipment  and 
ancillary  materials  ar .  listed  in  Appendix  A. 

Developing  and  acquiring  the  apparatus  and  equipment  for  this  project 
consumed  far  more  time  end  resources  than  had  been  anticipated.    Because  of 
the  novelty  and  innovati veness  of  these  exercises,  a  trial  and  error  approach 
was  applied  to  their  development.    There  were  many  "brain  storming"  sessions 
to  devise  adequate  designs  for  the  apparatu^^.    These  sessions  were  often 
followed  by  many  "scavenger-hunt"  days  to  find  suitable  materials.    An  aspect 
which  had  to  be  carefully  considered  during  this  project  concerned  the 
packaging  and  shipping  of  the  exercises.    Restraint  was  exercised  to  control 
the  size  and  weight  of  the  equipment  for  individual  exercises  in  order  to 
contain  shipping  costs  and  keep  the  materials  manageable  for  administrators. 

6.    Development  of  the  Scoring  Guides 

All  the  tasks  were  developed  with  corresponding  scoring  guides.  Because 
many  of  the  exercises  were  adapted  from  the  APU  science  project,  some  of  the 
scoring  guides  also  were  based  on  the  guides  provided  by  the  APU  science  team. 

Most  of  the  tasks  had  more  than  one  part  and  each  part  was  scored 
separately.    Student  responses  to  some  parts  were  simply  scored  correct  or 
incorrect;  for  example,  the  right  number  of  blocks  of  the  staircase  or  the 
correct  mathematical  equation.    Other  parts  were  scored  using  a  continuum 
which  took  into  account  correctness,  completeness,  and  level  of  cognitive 
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sophistication.    For  example,  the  relationship  between  the  amount  of  sand  in 
the  tubes  and  the  speed  the  tubes  rolled  down  the  incline  could  have  been 
erroneously  stated,  partially  stated,  or  completely  and  accurately  stated. 

All  scoring  guides,  including  those  modeled  after  the  APU,  were  developed 
over  the  course  of  several  stages  of  review  and  refinement.    NAEP  and  ETS 
staff  reviewed  and  revised  the  guides  as  did  members  of  the  APU  science  team. 
Attention  was  paid  to  the  recommendations  made  by  the  APU  science  team; 
nevertheless,  the  changes  made  to  the  original  APU  items  and  scoring  guides 
meant  that  the  final  results  for  the  group  and  station  exercises  were  quite 
different.    The  final  stage  of  scoring  guide  development  involved  revisions 
based  on  actual  student  responses  to  the  exercises.    Because  we  were  unable  to 
predict  the  complete  range  of  student  responses  before  the  administration, 
■he  final  revisions  helped  the  guides  better  represent  those  responses 
students  gave  during  the  field  test. 

7.    0MB  Clearance 

As  a  federally  funded  agency  responsible  to  OERI,  NAEP  is  responsible  for 
submitting  all  field  test  materials  to  OERI  and  to  the  Office  of  Management 
and  Budget  (0MB)  for  clearance. 

In  fulfillment  of  this  obligation,  NAEP  prepared  a  clearance  package  for 
review  in  early  December,  1985.    This  package  consisted  of  a  copy  of  all 
pilot-test  exercises,  including  the  NAEP  mathematics  and  science  blocks,  a 
justification  for  the  higher-order  skills  project,  and  an  outline  of  the 
pilot-test  methodology  and  analyses  to  be  conducted. 
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Upon  receipt  of  the  clearance  package,  OERI  staff  conducted  an  initial 
review  of  the  tasks  and  made  many  suggestions  for  revising  and  reformatting 
the  exercises.    Because  of  the  extensi veness  of  the  suggestions,  a  meeting  was 
scheduled  in  Washington  between  the  OERI  project  monitor  and  a  member  of  the 
NAEP  staff  working  on  the  project  to  discuss  the  suggested  changes  and  make 
the  necessary  revisions. 

Clearance  was  obtained  from  0MB  in  March,  1986. 
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CHAPTER  3 
PILOT  TESTING 

1.    The  Design 

The  design  for  administering. the  pilot  study  took  into  account  the  fact 
that  the  project's  requirements  placed  heavy  demands  on  the  time  and 
facilities  of  cooperating  school  districts  and  on  the  time  of  participating 
students.    The  essential  elements  of  the  plan  were: 

0    To  minimize  travel  costs,  each  participating  district  was  asked  to 
make  available  one  class  of  students  at  sach  of  the  three  grade 
level s. 

0    All  classes  in  the  sample  participated  in  a  half-hour  administration 
consisting  of  a  brief  set  of  background  questions,  a  14-minute  set  of 
either  mathematics  or  science  exercises  from  NAEP's  1986  national 
assessment,  and  15  minutes  of  newly  developed  paper-and-penci 1 
free-response  exercises.    These  booklets  were  spiralled  in  each 
district:  every  other  student  was  given  a  booklet  with  the  mathematics 
items,  and  every  other  student  a  booklet  with  science  items. 

0    All  students  in  the  sample  either  participated  in  full  investigations 
on  a  one-to-one  basis  with  an  administrator  or  in  station  activities 
in  a  group  of  six  students.    All  of  the  individually  administered  full 
investigations  were  pilot  tested  in  all  districts.    The  two 
investigations  for  grade  3  were  given  to  the  same  students  in  one  55 
minute  session.    NAEP  administered  the  same  three  investigations  at 
both  grades  7  and  11.    Some  students  were  given  two  investigations  in 
one  55  minute  session  while  others  were  administered  a  single  longer 
investigation  in  a  similar  time  frame.    (The  APU  administration 
allowed  the  same  average  time  for  each  investigation  and  the  same 
number  to  be  completed  by  each  student.) 
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0    To  conduct  the  station  administrations,  six  stations  were  to  be  set  up 
around  a  room  and  students  worked  on  each  activity  for  eight  minutes 
before  being  rotated  to  the  next  station.    In  each  district,  the  goal 
was  to  administer  the  station  activities  to  at  least  three  sets  of  six 
students  at  each  grade. 

0    Because  of  the  large  amount  of  equipment  required  for  the  stations  the 
station  activities  were  divided  into  two  sets,  A  and  B,  with  the  sets 
balanced  to  assess  similar  skills.    Only  one  of  the  sets  was 
administered  in  a  given  district. 

All  the  exercises  pilot-tested  are  shown  in  Table  3  by  administration 
type  and  by  grade  level. 
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Table  3. 

Pi  lot -Test  Tasks  by  Administration  Type  and  Grade  Level 

Group  Exercises 
G^^de  3  Grade  7 


1.  Whirlybird* 

2.  Hair  Color 

3.  Triathlon 


1.  Whirlybird* 

2.  Triathlon 

3.  Number  Relationships 

4.  Restaurant 


*Demonstrated  by  an  administrator 


Grade  11 


1. 
2. 
3. 


Triathlon 

Number  Relationships 
Restaurant 
4,    Heart  Rate  and 
Exercise 


Station  Activities 


A  Stations 
Station 


1 
2 
3 
4 
5 
6 

B  Stations 


Grade  3 

Gumballs,  Grade  3* 
Sand  and  Tubes 
Birds  (classify) 
Bubbles 

Double  Staircase 
Water  on  Brick 


Grade  7 

Gumballs,  Grade  7,  11* 
Sand  and  Tubes 
Seeds  (classify) 
Bubbles 

Double  Staircase 
Sugar  Cubes 


Grade  11 

Gumballs,  Grade  7,  11* 
Sand  and  Tubes 
Seeds  (classify) 
Bubbles 

Double  Staircase 
Magnet  and  Compass 


Station 

1 
2 
3 
4 
5 
6 


Grade  3 

Circle  Game* 
Rolling  Funnels 
Birds  (sort) 
Magnets 
Wig -Wag 

Seeds  (classify) 


Grade  7 

Number  Game* 
Roll ing  Funnels 
Seeds  (sort) 
Wig-Wag 

Tubes  and  Capillarity 
Balance  Scale 


Grade  11 

Number  Game* 

Rolling  Funnels 

Vertebrae 

Conductivity 

Tubes  and  Capillarity 

Balance  Scale 


*Administered  on  Apple  II  series  computers. 


Ful 1  Investigations 

Grade  3  Grades  7  and  11 

Pegboards  (30  minutes)  Pegboards  (30  minutes) 

Sugar  Cubes  (25  minutes)  Density  (25  minutes) 

Survival  (55  minutes) 
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2.    Obtaining  the  Sample 

The  first  phase  of  pilot  testing  involved  selecting  testing  sites.  These 
sites  were  drawn  from  districts  in  each  of  four  regions:  Northeast, 
Southeast,  Central,  and  West.    Within  each  of  these  regions,  districts  were 
selected  from  middle-income  urban,  disadvantaged  urban,  and  small  city  areas. 
The  only  stipulation  placed  on  the  selection  was  that  a  school  district  not  be 
part  of  the  NAEP  1985-86  national  assessment  sample.    Initially,  48  school 
districts  were  identified,  12  for  each  national  region.    Within  the  12,  four 
districts  were  representative  of  each  of  the  three  sizes  and  types  of 
community.    An  additional  check  was  made  with  the  QED  School  Guide  for  1985-86 
to  ensure  that  each  of  the  selected  districts  had  access  to  Apple  II  or  Apple 
II  compatible  computers  which  were  necesJ^^^v  for  some  of  the  station 
activities. 

The  initial  contact  within  a  district  was  made  with  the  school 
superintendent  by  telephone.    Staff  gave  the  superintendent  a  brief  overview 
of  the  project,  discussed  the  goals  of  the  pilot  test,  and  explained  the 
various  requisites  for  participation.    All  interested  superintendents  were 
sent  more  detailed  information  about  the  project  and  the  pilot  te">ting.  These 
superintendents  then  were  contacted  again,  and,  if  willing  to  participate  in 
the  project,  were  asked  to  designate  a  person  to  help  schedule  the  school 
administrations.    Each  district  was  asked  to  provide  three  classes  of 
students;  one  each  at  third,  seventh,  and  eleventh  grade.    NAEP  also  asked 
that  the  class  size  be  about  24-30  students  and  that  the  classes  be  drawn  from 
the  general  school  population  (i.e.,  not  an  honors  class  or  special  education 
class). 


1 
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The  third  contact  in  each  district  was  frequently  made  with  the  Director 
of  Research  within  the  district,  or  in  a  few  cases,  with  the  principals  of  the 
schools  selected  for  pilot  testiny.    If  it  was  the  research  director,  staff 
requested  the  names  of  the  principals  of  the  schools  selected  and  also  asked 
which  week  within  a  specified  four-week  period  would  be  most  convenient  for 
pilot  testing.    All  testing  for  this  project  was  conducted  between  March  17  - 
April  11,  1986. 

The  final  contact  was  made  with  the  principals  of  each  of  the 
participating  schools  to  determine  which  days  of  the  selected  week  would  be 
most  convenient  for  testing.    All  schools  were  told  that  testing  would  last  up 
to  a  day  und  a  half. 

Because  of  the  relatively  short  time  available  for  advance  notice  and  the 
complexity  of  the  project,  obtaining  cooperation  was  difficult.    Yet,  12 
districts  were  secured  for  the  pilot  test.    These  districts  represented  each 
of  the  four  regions  and  the  three  types  of  communities  within  all  but  one  of 
those  regions. 

3.    Recruiting  and  Training  Administrators 

In  preparing  to  train  administrators  for  the  pilot  study,  project  staff 
combined  NAEP  procedures  and  APU  procedures.    The  APU  used  practicing  science 
teachers  to  administer  the  "hands-on"  tests.    This  was  seen  to  be  particularly 
important  as  the  administrators  had  to  be  able  to  distinguish  what  was 
significant  and  relevant  about  pupils'  actions.    Furthermore,  the  training  of 
the  administrators  was  intensive  and  was  restricted  to  only  one  or  two 
investigations  at  most  and  a  single  category  test.    NAEP,  on  the  other  hand, 
has  a  tradition  of  hiring  and  training  administrators  to  minimize  the  burden 
on  the  schools.    However,  we  did  conduct  as  intensive  a  training  session  as 
possible  and  restricted  the  responsibilities  of  the  administrators  to  a 
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reasonable  number  of  tasks.    NAEP  and  APU  science  team  staff  trained  22 
administrators  to  conduct  the  pilot  test.    Fourteen  of  these  administrators 
were  recruited  through  an  agency  which  advertised  for  temporary  research 
assistants  with  backgrounds  in  primary  and/or  secondary  mathematics,  science 
education,  or  experience  with  children.    The  applicants  selected  for 
interviews  were  all  college  graduates  with  experience  in  either  mathematics, 
science,  or  related  areas.    The  remaining  eight  administrators  were  drawn  from 
NAEP  and  ETS  staff. 

NAEP  trained  the  administrators  in  a  five-day  session  held  during  the 
week  prior  to  pilot  testing.    The  APU  Deputy  Project  Director,  who  had  come 
from  London  to  assist  in  the  training,  had  many  fine  points  to  improve  the 
structure  and  administration  of  the  session.    The  first  day  for  all 
administrators  was  dedicated  to  an  overview  of  NAEP,  the  higher-order  skills 
project,  and  the  administration  of  the  group  activities.    After  the  first  day, 
the  session  was  designed  so  that  half  of  the  week  was  devoted  to  training  on 
the  station  exercises  and  the  remainder  of  the  week  was  devoted  to  training  on 
the  full  investigations.    Eight  of  the  administrators  were  trained  during  the 
first  half  of  the  week  on  the  station  exercises.    The  fourteen  administrators 
recruited  through  the  agency  were  trained  during  the  later  half  of  the  week  on 
the  full  investigations.    The  goal  wds  to  have  administrators  specialize  in 
one  specific  type  of  field  test  activity  so  that  it  would  be  administered  as 
reliably  as  possible.    For  example,  within  the  full  investigations,  half  of 
the  fourteen  administrators  were  trained  on  two  full  investigations  (Sugar 
Cubes  and  Survival )  and  the  remaining  seven  investigators  were  trained  on 
three  full  investigations  (Sugar  Cubes,  Pegboard,  and  Density). 

Staff  developed  an  administration  manual  for  use  by  the  administrators 
during  the  training.    Later,  the  manual  was  used  for  reference  in  the  field. 
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4.    Shipping  and  Administration 

All  bulky  materials,  including  the  station  equipment,  full  investigation 
equipment,  ara  the  test  booklets,  were  shipped  from  ETS  to  the  first  testing 
site  in  each  district.    The  administrators  were  responsible  for  hand-carrying 
the  small  or  fragile  materials  for  a  few  exercises  and  for  copies  of  the  full 
investigation  scripts  and  checklists.    Once  the  shipped  materials  had  arrived 
in  a  district,  the  administrators  were  responsible  for  transporting  the 
materials  from  site  to  site.    All  shipped  materials  were  sent  back  to  ETS  at 
the  conclusion  of  testing  in  each  district. 

Three  administrators  were  responsible  for  all  pilot -test  activities 
within  a  district.    One  administrator  was  responsible  for  the  group  exercises 
and  two  or  three  full  investigations,  one  for  the  other  full  investigations 
only,  and  one  for  the  station  activities  only.    The  group  exercises  were 
administered  first  in  each  school.    These  exercises  were  given  to  students  in 
their  classrooms.    While  the  group  exercises  were  administered,  the  other  two 
administrators  were  responsible  for  setting  up  equipment  in  the  three  testing 
areas  predesignated  by  the  school  principals.    The  administrator  responsible 
for  the  station  exercises  set  up  the  six  individual  stations  in  one  large 
testing  area.    The  administrator  responsible  for  the  full  investigations  set 
up  that  necessary  equipment  in  each  of  the  two  smaller  areas. 

Before  the  group  administration,  each  student  was  assigned  an  identifying 
code  indicating  grade,  district,  and  number  within  grade  and  was  instructed  to 
enter  this  code  on  all  booklets  and  response  sheets  used.  Following  the  group 
administration,  groups  of  eight  students  were  released  from  their  classrooms 
and  sent  to  one  of  the  three  testing  areas.  Six  students  were  assigned  to  the 
station  exercises  in  the  large  testing  area.  The  remaining  two  students  were 
each  sent  to  one  of  the  other  two  testing  areas  and  asked  to  complete  either 
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one  or  two  full  investigations.    For  each  investigation,  the  administrator 
presented  the  problem  and  recorded  the  student's  actions  on  a  behavioral 
checklist  while  the  student  worked.    Immediately  following  the  investigation, 
the  administrator  asked  questions  which  probed  the  student's  understanding  of 
the  problem  and  his/her  findings. 

All  students  then  returned  to  their  classrooms  and  the  next  group  of 
eight  was  sent  to  the  testing  areas.    After  the  last  set  of  students  was 
assessed,  the  administrators  packed  up  the  equipment,  collected  the  booklets, 
and  prepared  for  the  next  testing  site. 

All  school  principals  and  other  designated  school  personnel  were  thanked 
at  the  conclusion  of  the  testing  in  their  school.    Many  of  the  school  staff 
were  Interested  in  the  project  and  eager  to  discuss  it  with  the 
administrators.    Letters  of  appreciation  also  were  sent  to  the  district 
superintendent  and  to  all  the  individual  schools  after  the  pilot  testing  was 
over. 

5:.    Debriefing  the  Administrators 

About  one  month  after  the  last  week  of  testing,  NAEP  invited  the 
administrators  for  a  debriefing  session.    The  purpose  of  the  meeting  was  to 
discuss  the  administrators'  experiences  during  the  pilot  study.    The  following 
topics  were  discussed:    1)  the  administrators'  impressions  of  how  well  the 
exercises  worked  as  judged  by  the  students'  understanding  and  involvement  in 
the  task,  and  2)  how  the  logistics  of  the  activities  and  equipment  influenced 
the  efficiency  of  the  pilot  test.    A  form,  which  the  administrators  were  to 
fill  out  and  return  to  NAEP,  considered  the  logistical  issues  in  more  detail. 
This  form  was  based  on  one  that  was  originally  used  by  the  APU  science  team 
for  their  debriefing  sessions. 
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During  the  two  and  one-half  hour  discussion,  the  administrators  provided 
specifics  about  the  efficacy  of  the  various  exercises  and  how  they  might  be 
revised  for  future  use.    For  example,  in  discussing  the  group  exercises  the 
administrators  reported  that  the  vocabulary  tended  to  be  too  difficult  for  the 
third  grade  students.    They  reported  that  the  younger  students  also  had 
difficulty  understanding  some  of  the  tasks,  particularly  the  Whirlybird  which 
was  originally  used  with  older  children  in  the  APU  science  sample. 

For  the  station  exercises,  the  administrators  reported  no  problems  in 
moving  the  students  from  station  to  station.    However,  they  did  report  that 
not  all  exercises  required  eight  minutes  and  that  students  had  difficulty 
understanding  the  resources  for  Seeds  (sort)  (grade  7)  and  Birds  (sort)  (grade 
3).    Although  students  at  all  grades  enjoyed  the  computer  exercises,  many  of 
the  students  were  unable  to  complete  the  exercises  in  the  allotted  time.  The 
administrators  also  noted  a  lack  of  clarity  in  the  instructions  for  a  few  of 
the  exercises.    Finally,  they  made  several  good  suggestions  about  the 
equipment:    improve  the  hooks  on  the  balance  scale  and  provicc  plastic  rather 
than  glass  equipment,    (If  glass  equipment  is  used,  be  sure  to  provide 
replacement  beakers  and  tubes.) 

When  discussing  the  full  investigations,  the  administrators  noted  that 
many  of  the  younger  students  had  difficulty  with  the  concepts  used  in  the 
problems  (i.ee,  "dissolving"  in  Sugar  Cubes  at  grade  3).    In  a  few  instances, 
the  younger  students  only  used  those  behaviors  demonstrated  by  the 
administrator  during  the  problem  introduction.    Also,  some  third-grade 
students  had  difficulty  completing  the  response  sheets.    An  additional  issue 
raised  concerned  the  appropriateness  of  prompting  students  when  they  appeared 
to  be  at  standstill  in  conducting  the  full  investigations.    The  APU  has 
administered  the  investigations  in  two  ways,  with  and  without  a  set  of 
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scripted,  structured  prompts.    NAEP  decided  not  to  have  prompts;  but,  in  the 
pilot  study  some  administrators  prompted  the  students  into  working  on  the 
investigations  after  an  unusually  long  pause  in  work  or  when  a  student  was 
unclear  about  the  task.    This  seemed  much  less  awkward  and  it  was  suggested 
that  a  standardized  prompt  be  included  in  the  administrator's  scripts  in 
future  assessments. 

The  administrators  also  discussed  the  effectiveness  of  the  training 
materials.    The  administrators  noted  that  they  would  have  appreciated  more  dry 
runs  in  the  training  and  some  "dress  rehearsals"  with  children,  if  possible. 
The  APU  training  sessions  for  the  full  investigations  involved  the 
administrators  in  coding  checklists  while  observing  video  tapes  of  pupils  and 
finally  with  actual  pupils.    The  reliability  of  the  administrators  was 
determined  during  the  training  session.    It  was  found  essential  to  provide 
administrators  with  lists  of  typical  coding  errors  so  that  they  could  check  on 
their  own  consistency  while  in  the  field.    In  addition  all  checklists  were 
checked  by  APU  personnel  for  internal  consistency  prior  to  being  put  on  the 
computer.    The  checklists  were  designed  to  make  administrator  errors  obvious. 

Topics  that  were  briefly  covered  included  the  educational  caliber  of 
students  in  the  field  test,  the  unrepresentative  classes  provided  in  two 
schools,  and  how  to  improve  communications  with  the  individual  schools  prior 
to  testing. 

In  general,  the  administrators  reported  that  most  of  the  students  were 
highly  motivated  and  willing  to  participate  and  that  the  schools  were  very 
interested  in  the  project. 
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CHAPTER  4 
ANALYZING  THE  DATA 

Scoring  and  Data  Entry 

A.  Scoring 

NAEP  and  ETS  staff  members  scored  the  student  responses.    A  training 
session  was  held  to  ensure  that  all  scorers  were  in  agreement  about  the 
definition  of  each  score  point.    Involved  staff  discussed  the  scoring 
guides  for  each  of  the  exercises  and  how  they  should  be  applied  to  student 
responses.    Sample  papers  were  used  to  familiarize  scorers  with  the  types 
of  student  responses  to  each  of  the  different  questions.    To  conduct 
reliable  scoring,  scorers  reviewed  samples  until  achieving  consensus  on 
each  score  point « 

Scorers  were  responsible  for  placing  their  assigned  scores  in  the 
test  booklets  beside  the  student  responses.    For  the  computer  administered 
exercises,  the  printout  of  the  student  responr.ra  was  scored  in  the  same 
way.    Because  the  score  ranges  were  different  ^cross  exercises  and 
exercise  parts  and  because  NAEP  was  most  interested  in  the  cognitive 
skills  demonstrated  by  the  particular  exercise  ,  irts,  total  scores  were 
not  provided  for  multi-part  exercises.    Re"!idbility  was  monitored  by 
having  project  staff  periodically  review  score*  .coklets. 

All  scoring  was  completed  in  i.pprcxi  three  weeks. 

B.  Data  Entry  and  Organization 

Staff  began  scoring,  organizing,  and  entering  the  data  while  actual 
administration  of  the  assessment  was  still  underway,  with  this  activity 
continuing  until  several  weeks  after  date  collection  had  been  completed. 
Data  entry  was  divided  into  three  principal  tasks.    The  first  involved 
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organ1z1ng  the  data  Into  a  format  that  would  both  facilitate  the  data 
analysis  and  minimize  storage  costs  by  avoiding  excessive  redundancy. 
With  this  In  mind,  the  data  was  divided  among  twelve  files  containing  the 
following  Information: 

1)    HOSCODES  Information  about  which  activities  were  completed  by 

each  student; 

Grade  3  mathematics  and  group  data; 
Grade  7  mathematics  and  group  data; 
Grade  11  mathematics  and  group  data; 
Grade  3  science  and  group  data; 
Grade  7  science  and  group  data; 
Grade  11  science  and  group  data; 
Data  from  the  station  administration; 
Data  from  the  "Sugar  Cubes"  full  Investigation; 
Data  from  the  "Pegboards"  full  Investigation; 
Data  from  the  "Density"  full  Investigation; 
Data  from  the  "Survival"  full  investigation; 
The  second  task  required  developing  a  data  entry  system  to  permit 
easy  input  and  modification  of  the  data.    This  system  was  written  using  a 
menu  driven  concept  that  effectively  Isolated  data  in  each  of  the  files 
described  above  whi'e  allowing  easy  access  to  individual  student  records 
through  the  »JS6  of  the  f^tudent  codes. 

NAEP  u?ed  the  S/^S  r:itat1st leal  package  to  generate  encrypted  data  sets 
that  contained  not  only  the  raw  data,  but  also  summary  statistics  for  each 
of  the  portions  of  the  assessment.    For  the  1986  NAEP  assessment  items 
given  as  the  first  part  of  the  group  administration,  these  summary 
statistics  Included  the  answer  key  for  each  cognitive  item,  the  number  of 


2)  H0SMA3 

3)  H0SMA7 

4)  HOSMAll 

5)  H0SSCI3 

6)  H0SSCI7 

7)  HOSSCIll 
3)  HOSCIRC 
9)  HOSSUGAR 

10)  HOSPEGBD 

11)  HOSDENSI 

12)  HOSSURVI 
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items  each  student  answered  correctly,  the  number  omitted,  and  the  number 
not  reached.  Similar  summary  statistics  were  generated  for  the  group  and 
station  activities  and  for  the  full  investigations. 

Two  research  assistants  were  responsible  for  entering  the  data  on  a 
VTIOO  terminal  which  was  used  with  a  modem  to  access  the  Princeton 
University  mainframe.    Data  was  entered  twice  whenever  possible  to  ensure 
that  all  scores  were  entered  accurately. 

2.    The  Limitations  of  the  Data 

The  purpose  of  the  pilot  test  was  two-fold.  First,  NAEP  wanted  to  see  if 
it  would  be  possible  to  field  such  complex  materials,  even  on  a  limited  scale. 
Because  this  type  of  assessment  is  very  rare  in  the  United  States,  managing 
the  equipment  involved,  obtaining  school  cooperation,  training  administrators, 
and  actually  collecting  students'  responses  all  were  special  hurdles.  Second, 
U  the  logistics  of  the  administration  went  well,  NAEP  wanted  to  know  if  these 
types  of  tasks  would  be  appropriate  for  an  actual  national  assessment.  More 
specif ical ly : 

0    Did  students  appear  to  understand  the  questions  and  equipment? 

0    Did  the  difficulty  level  of  the  tasks  appear  appropriate  to  the  grade 
levels  sampled? 

0    Were  students  motivated  by  the  tasks? 

0    Could  we  detect  any  evidence  of  systematic  bias? 

0    Did  the  results  seem  to  make  sense  from  the  perspective  of  what  the 
tasks  were  designed  to  measure? 

0    Would  the  results  of  a  national  assessment  yield  useful  information? 

The  data  obtained  from  the  pilot  study  were  adequate  for  most  of  these 
purposes.    A  total  of  907  students  responded  to  the  pilot  test  materials. 
Data  were  available  for  286  third-grade  students,  317  seventh-grade  students, 
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and  304  eleventh-grade  students.    All  students  participated  in  the  group 
administraticis,  but  the  sample  sizes  for  the  "hands-on"  tasks  were  smaller. 
The  logistics  involved  in  pulling  students  from  their  classes  and  the 
constraints  of  conducting  these  "hands-on"  sessions  within  the  school  schedule 
meant  that  fewer  students  than  anticipated  were  assessed  in  the  time  allowed. 
We  had  hoped  that  one-half  of  the  students,  about  150,  would  participate  in 
each  set  of  station  activities  developed  for  that  grade  level.    In  actuality, 
the  sample  sizes  are  closer  to  100  students  for  each  station  activity.  The 
individual  administrations  seemed  to  be  even  more  time  consuming  and  the 
sample  sizes  on  those  tasks  range  from  about  50  to  80  students  across  the 
grade  levels. 

Further,  it  must  be  stressed  that  this  sample  was  not  a  representative 
probability  sample.    It  was  based  on  districts  selected  to  give  us  a  range  of 
students,  not  in  the  proportions  that  reflect  national  population 
characteristics,  but  so  we  could  tell  if  the  exercises  would  be  appropriate 
for  low-  as  well  as  high-ability  students.    Also,  the  pilot-test  sample  was 
based  on  voluntary  participation  by  the  districts  drawn  in  the  initial 
descriptive  sample.    It  seems  reasonable  in  terms  of  demographics:    at  each 
grade  level  about  one-half  were  male  and  one-half  female;  and  about  70  percent 
were  white  students  and  30  percent  were  minorities.    In  addition,  the  sample 
contained  some  students  with  little  previous  science  or  mathematics  experience 
and  others  who  reported  a  range  of  science  and  mathematics  coursework.  The* 
background  questions  asked  at  each  grade  appear  in  Appendix  B. 
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Finally,  it  should  be  noted  that  even  when  NAEP  conducts  national 
assessments  based  on  a  deeply  stratified,  multi-stage  random  probability 
samples,  it  does  not  obtain  reliable  results  for  individual  students,  only  for 
groups  of  students.    The  results  from  the  pilot  test  cannot  be  used  to  make 
judgments  about  student  performance.    They  can  only  be  used  to  make  .judgments 
about  the  tasks. 

3.    Analyses  Conducted 

Because  the  purpose  of  the  pilot  test  was  to  obtain  information  about  the 
appropriateness  of  the  tasks,  net  reliable  information  about  student 
performance,  the  small,  unrepresentative  sample  limited  the  types  of 
meaningful  analyses  that  could  be  performed.    NAEP  computed  the  percentage  of 
students  responding  to  each  part  of  each  exercise  at  each  score  level. 
Results  also  were  analyzed  by  gender,  but  information  about  any  other 
subpopulations  would  have  been  based  on  very  small  cell  sizes. 

As  mentioned  earlier,  students  were  not  given  overall  scores  on 
multi-part  exercises  and  no  attempt  was  made  to  combine  scores  in  the 
analysis.    However,  this  should  be  done  with  national  assessment  results  and 
the  pilot-study  results  indicated  how  this  might  be  accomplished.    As  a  matter 
of  interest,  NAEP  did  correlate  performance  on  most  of  the  pilot-tested  tasks 
with  performance  on  the  1986  assessment  items.    However,  given  the  small 
number  of  items  in  each  of  the  math  and  science  tests  and  the  limitations  of 
the  sample,  the.ie  results  are  not  particularly  useful. 
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4.    Third  Advisory  Panel  Meeting 

The  third  advisory  panel  for  the  project  met  in  June.    The  five  panel 
members,  all  of  whom  had  participated  on  one  or  both  of  the  earlier  [lanels, 
were  Audrey  Champagne,  Roberta  Flexer,  Gerald  Kulm  (formerly  the  project 
officer  for  OERI  but  now  with  the  American  Association  for  the  Advancement  of 
Science),  James  Minstrell,  and  Patricia  Murphy.    Also  participating  were 
Joanne  Capper,  representing  the  National  Association  of  Chief  State  School 
Officers,  and  Richard  Berry  from  NSF.    The  four  project  staff  members  who 
participated  in  the  two  previous  panel  meetings  were  joined  by 
Andrew  Mychajlowycz  who  had  responsibility  for  data  management. 

The  purpose  for  the  panel  meeting  was  to  review  and  critique  the 
pilot-tested  tasks,  review  the  data,  and  make  suggestions  for  task  revision. 
All  the  tasks  were  displayed  as  they  were  set  up  during  the  pilot  tests  and 
all  the  participants  tried  each  of  the  various  activities.    This  fami'^iarized 
them  with  what  the  students  had  actually  been  asked  to  do  and  enabled  them  to 
critique  the  tasks  more  effectively.    The  remainder  of  the  meet-^ng  was  devoted 
to  discussions  of  the  strengths  and  weaknesses  of  each  task  based  on  the 
panelists'  judgments  and  the  pilot -test  results.    The  panelists  also  discussed 
the  overall  potential  of  the  task  for  national  assessment  and  recommended  ways 
to  report  data  from  a  national  assessment.    Patricia  Murphy's  comments  on  how 
the  APU  science  team  had  handled  similar  assessment  issues  were  particularly 
helpful . 

The  panel  members  were  very  enthusiastic  about  the  pilot-tested  tasks. 
They  were  extremely  impressed  by  the  innovative  nature  of  the  tasks  and  agreed 
that  an  assessment  consisting  of  such  activities  would  have  a  positive  impact 
on  curriculum  and  coursework  in  mathematics  and  science.    They  further  agreed, 
especially  considering  the  lack  of  student  experience  with  these  types  of 
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materials  in  their  classrooms,  that  most  of  the  tasks  seem  to  be  at  abjiit  the 
right  difficulty  level.    At  each  grade  level,  essentially  every  stud'.-nt 
attempted  each  task  they  were  given.    Also,  students  appeared  to  be  t airly 
successful  on  the  sorting  and  classifying  tasks  and  able  to  understand  and 
complete  the  data  interpretation  tasks. 

Again,  the  pilot -test  data  must  be  interpreted  with  caution,  but  it  did 
appear  that  students  had  more  difficulty  with  the  tasks  based  on  observing 
scientific  and  mathematical  principles.    Also,  it  appeared  that  students  were 
generally  unfamiliar  with  the  principles  involved.    These  results 
substantiated  the  validity  of  these  tasks  as  emphasizing  thinking  rather  than 
knowing.    Further,  in  conducting  the  csctivities  and  observing  the  results, 
students  dio  r.ot  appear  to  search  for  relationships— or  at  least  they  did  not 
volunteer  those  kinds  of  responses  unless  explicitly  asked  to  do  so.    If  the 
question  explicitly  asked  the  students  to  determine  a  relationship,  they 
generally  were  able  to  do  so.    However,  if  the  question  simply  asked  them  to 
write  down  what  they  noticed,  the  responses  tended  to  be  descriptive  step  by 
step  records  rather  than  generalizations  of  the  relationships  they  had 
observed.    A  rational  assessment  would  need  to  Incorporate  a  variety  of  these 
types  of  questons  to  insure  interpretable  results.    Still,  students  responded 
to  these  tasks  and  improved  performance  was  noted  across  the  three  grade 
levels  for  those  tasks  given  at  more  than  one  level. 
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As  was  expected  on  the  full  investigat-'ons,  students  did  not  appear  to  be 
adept  at  conducting  experiments  and  manipulating  the  variables  involved.  But, 
similar  to  the  results  obtained  in  England,  Wales,  and  Northern  Ireland, 
students  did  recognize  the  major  variables  and  take  measurements  in  conducting 
their  experiments.    Also,  response  levels  were  high  and  improvement  was 
evidenced  across  the  grade  levels. 

I.    Review  of  Assessment  Tasks 

Although  the  tasks  as  a  whole  were  positively  received,  the  panel 
members  made  a  number  of  suggestions  for  improving  the  wording, 
equipment,  questions,  administration,  and  scoring  of  the  individual 
tasks.    These  are  detailed  in  Part  II,  but  some  illustrative  examples 
fol low: 

0    For  Sand  and  Tubes  and  Rolling  Funnels,  it  was  suggested  that 

students  should  be  asked  to  predict  what  would  occur,  and  that  these 
activities  might  be  administered  to  groups  of  studentb. 

0    A  foods  classification  and/or  sort  task  with  the  potential  for 

assessing  the  quality  of  the  students'  classifications  was  proposed. 

0    Vertebrae  and  Conductivity  (pilot-tested  at  grade  11)  and  Water  on 
Brick  (pilot -tested  at  grade  3)  also  could  be  used  at  grade  7.  (APU 
has  used  comparable  e>:ercises  for  age  13.) 

II .    Additional  Recommendations  and  Suggestions 

0   The  scoring  guides  should  be  revised  to  reflect  finer  gradations  of 
behavior.    This  would  provide  better  Information  about  students* 
different  approaches  to  problem  solving  tasks. 
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0    Students  also  should  be  evaluated  on  their  performance  across  the 
parts  of  each  task.    For  example,  Patricia  Murphy  suggested  that  the 
different  approaches  taken  by  students  in  solving  the  full 
investigations  be  classified  into  different  levels  of  competence. 
Criteria  for  competence  could  be  defined  in  terms  of:  1)  how  students 
conceptualized  the  problem,  2)  how  reliably  they  manipulated  the 
independent  variables,  and  3)  how  efficiently  they  measured  the 
dependent  variable. 

0    It  would  be  important  to  obtain  results  by  race/ethiiicity . 

0    A  national  assessment  should  investigate  the  relationship  between 
performance  on  the  problem-solving  tasks  and  curriculum  and 
coursework. 

5.    Summary  and  Recommendations 

The  development  and  pilot  testing  of  innovative  tasks  to  assess  higher- 
order  thinking  in  mathematics  and  science  has  presented  a  tremendous  challenge 
to  the  project  staff,  but  the  outcomes  demonstrate  that  "hands-on"  assessment 
in  the  schools  is  feasible,  albeit  costly,  time  consuming,  and  demanding  on 
the  schools  and  the  exercise  administrators.    The  enthusiasm  of  the  advisory 
panels,  the  school  cooperation,  and  the  face  validity  of  "hands-on"  tasks  for 
assessing  higher-order  thinking  in  science  and  mathematics  indicate  that  a 
national  assessment  of  higher-order  skills  would  be  of  great  interest  and 
utility. 

The  Tasks 

Thirty  different  tasks  were  pilot  tested  of  which  six  were  group 
exercises,  twenty  station  activities,  and  four  full  investigations.    Eleven  of 
the  exercises  were  pilot  tested  in  one  grade  only;  the  others  were  tried  in 
two  or  three  grades.    Based  on  the  review  by  the  third  advisory  panel  of  the 
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tasks  with  their  equip^nent  and  pilot-test  data,  the  panel's  discussion  and 
recommendaf ions,  and  the  summary  comments  on  each  of  the  tasks,  there  are 
seventeen  tasks  that  can  be  recommended  fc.  potential  future  use  unchanged  or 
with  minor  revisions  or  equipment  improvement  chat  would  not  require  new 
pilot  testing,  seven  for  which  the  ideas  were  good  enough  to  warrant  the 
needed  revision  and  new  pilot  tests,  three  that  would  need  new  equipment 
and/or  macerials,  and  three  that  were  r  t  recommended. 
1 .     Tasks  Available  For  Future  Use  Essent^  ly  Unchanged 

Group;  Whirlybird-Grade  3  and  7,  Hair  Color-Grade  3,  Triathlon-Grades 

3,  7,  and  11,  Number  Relationships-Grade  7  and  11,  Heart  Rate  and 

Exercise-Grade  11 

Stations:    Birds(classify)-Grade  3,  Seeds(classify )-Grades  3,  7,  and 
11,  Seeds(sort)-Grade  7,  Vertebrae(sort )-Graae  11  and  also  extended 
to  Grade  7,  Double  Staircase-Grades  7,  and  11,  but  not  3, 
Wig-Wag-Grades  3  and  7,  Water  on  Brick-Grade  3  and  also  extended  to 
Grade  7,  Magnet  end  Compass-Grade  11,  Conductivity-Grade  11,  but 
could  be  extended  to  Grade  7 
Full  Investigations:    Sugar  Cubes-Grade  3,  Density-Grade  7  and  11, 
Survival -Grades  7  and  11 
Although  the  panels  especially  liked  the  individually  administered  full 
investigations,  these  tasks  are  much  more  costly  and  time  consuming  than 
self-administered  station  activities.    Inclusion  of  full  investigations  in  a 
national  assessment  is  therefore  dependent  on  the  total  level  of  support  for 
the  project.    The  panel  recommended  use  of  Sugar  Cubes  at  grade  3  and  Survival 
at  grades  7  and  11  if  only  one  full  investigation  at  a  grade  could  be  included 
in  a  national  assessment. 
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2.  Good  Ideas  Worth  Major  Revision  and  New  Pilot  Testing 

Stations:    All  the  computer-administered  tasks  -  i.e.  Gumball 
Game-Grades  3,  7,  and  11,  Circle  Game-Grade  3,  Numbers  Game-Grades  7 
and  11;  Sand  and  Tubes-Grades  3,  7,  and  11  and  Rolling  Funnels-Grades 
3,  7  and  11  could  be  turned  into  administrator-demonstrated  group 
exercises  or  computer  response  exercises  including  prediction  of  the 
result;  Magnets-revised  and  possibly  extended  to  all  three  grades; 
Balance  Scale-Grades  7  and  11 

3.  Need  New  Equipment  or  Materials 

Stations:    The  ideas  for  Bubbles,  Bird(sort),  and  Tubes  and  Capillarity 
could  be  retained  with  improved  or  different  apparatus  or  resource 
materials. 

4.  Not  Recommended 

Group:  Restaurant 

Stations:    Sugar  Cubes  (as  a  station  for  Grade  7)  was  simply  too 

complex  to  be  a  station  activity. 
Full  Investigation:  Pegboards 
Overall,  the  administrations  in  the  schools  went  better,  with  fewer 
problems,  than  had  been  expected.    However,  problems  that  affected  the  quality 
of  the  data  on  the  computer-administered  exercises  and  on  the  full 
investigations  were  identified  during  the  scoring  and  data  analysis  phases. 

In  using  computer-administered  tasks  in  future  assessments,  it  will  be 
necessary  to  develop  rigorous,  written  procedures  for  the  administrators  who 
set  up  and  monitor  the  computer  tasks  to  prevent  loss  of  data  through 
administrator  or  student  error.    Administrators  also  will  need  more  extensive 
training  in  the  usi  of  the  computer  and  the  requirements  to  operate  specific 
programs. 
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For  the  individual  investigations,  administrators  need  more  intensive 
training  on  how  to  observe  the  students  and  record  what  they  observe. 
Therefore,  it  is  strongly  recommended  that  plans  for  any  operational  use  of 
full  investigations  include  the  video-taping  prior  to  the  training  period  of 
several  students  at  each  grade  as  they  carry  out  the  investigation.  The 
video-tapes  would  then  become  the  actual  cases  on  which  the  administrators 
could  practice  and  compare  results  until  agreement  is  reached. 

Although  the  scoring  guides  were  adequate  for  this  project's  purpose  of 
assessing  the  quality  and  feasibility  of  the  tasks,  there  were  a  number  of 
tasks  in  which  refinement  of  the  guides  would  be  desirable.    A  number  of  the 
scoring  guides  could  be  expanded  to  differentiate  between  responses  that  were 
clustered  together.    Further,  substantial  thought  needs  to  be  given  to  the 
assessment  priorities.    It  is  clear  that  a  national  assessment  of  these  tasks 
could  yield  very  worthwhile  information.    Yet  it  is  doubtful  that  it  could 
answer  all  the  questions  raised  by  NAEP's  consultants.    The  goals  would  have 
to  be  clearly  defined  and  once  these  were  determined,  appropriate  analyses 
could  be  designed. 

In  this  project,  NAEP  has  made  a  good  start  toward  a  national  assessment 
of  higher-order  thinking  in  science  and  mathematics.    A  number  of  tasks  are 
available  for  use.    But  more  would  be  needed  if  a  full  set  of  "hands-on" 
station  activities  assessing  a  broad  range  of  skills  is  to  be  used  at  each 
grade.    The  extent  of  additional  developmental  work,  not  only  in  task 
development,  but  in  other  areas  as  well,  necessary  to  conduct  a  national 
assessment,  would  very  much  depend  on  the  goals  and  scope  of  thr^  assessment. 
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APPENDIX  A 
EQUIPMENT  LISTING 

I,      GROUP  EXERCISES 
Whirlybird 

Horizontal  rotor  and  base,  6  ball  bearings  of  equal  mass  and  volume, 
spare  rubber  bands  and  a  spare  ball  bearing. 

Hair  Color 

No  apparatus  needed 

Triathlon 

No  apparatus  needed 

Number  Relationship 

1^0  apparatus  needed 

Heart  Rate  and  Exercise 
No  apparatus  needed 

Restaurant 

No  apparatus  needed 


IK    STATION  EXERCISES 
Sand  and  Tubes 

Three  identical  capped  glass  test  tubes  labelled  A,  B,  and  C,  each  filled 
with  sand  to  different  levels;  one  empty  capped  glass  test  tube  labelled 
D;  wooden  incline  with  START  clearly  printed  on  the  top  of  the  incline; 
paper  and  pencils.  ^ 

Rolling  Funnels 

A  double  cone  made  with  two  identical  plastic  funnels;  a  wooden  board 
with  two  diverging  rails  and  points  at  opposite  ends  labelled  A  and  B; 
an  empty  tin  can. 

Gumbal Is 

Apple  II  Series  Computer  with  48K  memory,  diskette  with  program,  paper 
and  pencil . 

The  Circle  Game 

Apple  II  Series  Computer  with  48K  memory,  diskette  with  program,  paper 
and  pencil . 

The  Numbers  Game 

Apple  II  Series  Computer  with  48K  memory,  diskette  with  program,  paper 
and  pencil. 
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Birds  (classify) 

Four  colored  photographs  of  birds  labelled  A,  B,  C,  and  D  that  are 
individually  mounted  on  cardboard.    Birds  should  differ  in  morphology 
(type  of  legs,  beak,  size,  and  coloring). 

Birds  (sort) 

Seven  colored  drawings  of  birds  labelled  A  to  G  that  are  individually 
mounted  on  cardboard.  Birds  should  vary  in  morphology  (color  of  breast, 
beak,  size  and  crest). 

Wig-Wag 

One  inertia  balance,  two  large  C-clamps,  one  block  of  lead  labelled  A, 
one  block  of  aluminum  labelled  B,  one  block  of  wood  labelled  C,  one  block 
of  balsa  wood  labelled  D. 

Magnets  (strength) 

Two  disk  magnets  labelled  A  and  B  that  are  comparable  in  mass,  size, 
shape,  and  external  appearance  (strength  of  magnets  should  be  such  that 
one  magnet  is  4-5  times  stronger  than  the  other  one);  large  metal  paper 
clips;  assorted  metal  washers,  plastic  poker  chips,  paper  and  pencil. 

Water  on  Brick 

Eyedroper,  small  bottle  filled  with  water;  small  equal-sized  pieces  of 
plastic,  painted  wood,  brick,  metal,  roof  shingle,  and  an  unknown 
material  (piece  of  porous  cinder  block)  in  a  transparent,  plastic  bag; 
magnifying  glass,  paper  and  pencil. 

Bubbles 

Small  and  large  bubble  wand  of  different  shapes  (square,  circular,  and 
triangular);  paper  towels,  1  small  bottle  of  bubble  mixture  (containing 
dishwashing  liquid  and  water),  paper  and  pencil.    For  grade  3  students 
only  the  square  and  circu^^ar  wands  will  be  used. 

Bal ance  Scale 

A  balance  scale  set  up  and  balanced  with  equally  spaced  holes  for  hooks, 
five  10  gram  metal  washers,  one  30  gram  plastic  film  canister;  paper  and 
pencil . 

Seeds  (classify) 

Containers  filled  with  samples  of  labelled  but  unnamed  seeds:  A=caraway 
seeds,  B=cumin  seeds,  C=black  peppercorns,  D=millet  seeds,  E=fennel 
seeds,  F=all  spice,  G=white  peppercorns,  H=yellow  mustard  seeds, 
J=fenugreek  seeds,  X=coriander,  Y=barley.    For  the  grade  3  students,  only 
groups  1  and  2  will  be  used. 

Double  Staircase 

"Double  staircase"  of  wooden  blocks  that  is  4  blocks  high,  and  glued  to  a 
wooden  base;  24  loose  wooden  blocks  that  are  identical  to  those  used 
in  the  staircase;  graph  paper  and  pencil. 

Vertebrae  (grouping) 

Eleven  bones  labelled  A-L  as  follows:    A=Lumbar  dog,  B=Cervical  rabbit, 
C=Thoracic  dog,  D=Thoracic  cat,  E=Lumbar  dog,  F=Atlas  coyote,  G=Cervical 
rabbit,  H=Cervical  dog,  J^-Lumbar  rtLbit,  K=Thoracic  rabbit,  L=Lumbar 
rabbit. 
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Seeds  (sort) 

Containers  filled  with  samples  of  labelled  but  unnamed  seeds:  A=caraway 
seeds,  B=cumin  seeds,  C=black  peppercorns,  D=millet  seeds,  E=fennel 
seeds,  F=all  spice,  G=white  peppercorns,  H=yenow  mustard  seeds, 
J=fenugreek  seeds.    (Group  A=A,  B,  and  E;  Group  B=C,  F,  and  G;  Group  C=D, 
H,  and  J}* 

Tubes  and  Capillarity 

Beaker  containing  colored  water,  five  small  open-ended  glass  tubes 
labelled  A,  B,  C,  D  and  E,  of  equal  length  but  different  interior 
diameters,  and  one  open-ended  glass  tube  labelled  X  of  the  same  diameter 
as  one  of  the  five,  a  six-inch  ruler  (Administrator  should  make  sure  that 
only  five  tubes  are  placed  in  the  water.    The  sixth  tube  should  be  placed 
along  side  but  not  in  the  beaker  and  should  match  the  size  of  one  of  the 
five  tubes  in  the  solution).    The  dish  should  be  filled  up  to  the  top 
before  every  administration. 

Conductivity 

Five  sealed  black  boxes  labelled  A-E  containing  the  following  materials: 
A=a  piece  of  copper  wire,  B=a  resistor,  C=a  piece  of  wood,  D=a  diode,  E=a 
micro  relay;  three  1.5-volt  batteries  in  holder;  one  circuit,  set  up  and 
preset  with  resistance;  two  contacts,  two  sockets  mounted  on  board 
springs  or  metal  sloping  blocks;  three  spare  batteries. 

Magnet  and  Compass 

Sealed  box  labelled  X  containing  two  bar  magnet?;  fixed  firmly  in 
position,  a  compass,  a  work  sheet  depicting  a  rectangular  box  the  same 
size  as  box  X  and  ten  circles  around  the  perimeter  of  the  rectangle, 
paper  and  pencil . 

Sugar  Cubes 

Six  small  glass  beakers,  sugar  cubes  in  packet,  six  packages  of 
granulated  sugar  each  containing  the  same  mass  of  sugar  as  in  one  cube; 
stop  watch;  hot  water  in  thermos. 


III.  FULL  INVESTIGATION  EXERCISES 
Sugar  Cubes 

Six  small  glass  beakers,  sugar  cubes  in  packet;  six  packages  of 
granulated  sugar  each  containing  the  same  mass  of  sugar  as  in  one  cube; 
hot  water  in  thermos  (50  C-60°C);  two  stirrers,  stop  watch,  graduated 
beaker,  measuring  cup,  small  ruler,  paper  towels 5  paper  and  pencil. 

Pegboards 

Nine  pegboards  of  three  different  lengths  and  three  different  widths, 
stop  watch,  12-inch  ruler,  two  ring  stands,  two  clamps,  two  rods  and 
hooks. 

Density 

Three  different  sized  blocks,  labelled  A,  B,  and  C  of  different  shapes 
and  of  materials  of  different  densities;  a  large  open  box;  spring  scale, 
ruler,  hand  calculator,  paper  and  pencil  (Note:    The  blocks  will  be  a 
rectangular  solid,  a  cube,  and  a  triangular  block  which  is  half  a 
rectangular  solid).  ^ 
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Survival 

Five  cans  labelled  A-E  (two  identical  aluminum  cans  A  and  B,  one  plastic 
can  E  with  the  same  dimensions  as  A  and  B,  one  aluminum  can  C  that  is  the 
same  height  as  A,  B,  and  E  but  of  a  larger  diameter,  one  aluminum  can  D 
with  the  same  diameter  as  A,  B,  and  E  but  shorter  height);  llO^C 
thermometer,  a  stopwatch,  rubber  bands,  pins,  transparent  tape,  scissors, 
electric  kettle,  two  grduated  cylinders,  sheets  of  blanket,  sheets  of 
plastic,  electric  fan,  small  ruler,  graph  paper,  thermos,  paper  towels, 
and  pencils. 

IV.    UTILITY  KIT  AND  ANCILLARY  MATERIAL 

Extension  Cord 
Glue 

Scotch  Tape 

Magic  Marker 

Scissors 

PI  iers 

Screwdriver 

Pencil  Sharpener 

Strapping  Tape 

Screws  for  Whirly  Bird 

Extra  Labels 

Extra  Betteries  (Timers  and  Stop  Watch) 
Allen  Wrench  (to  adjust  balance  beam) 
Timer 

2  pads  (extra  paper  if  needed) 

18  pencils 

Station  signs  1-6 

CI ipboard 

Graph  paper 

Ruler 
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APPENDIX  B 

GRADE  3 

GROUP  EXERCISES 
3M 

SECTION  1 

For  each  of  the  questions  that  follow,  fill  in  the  oval  next  to  the  answer  you 
choose • 

1.  Are  you  male  or  female? 

O  Male 
O  Female 

2.  Which  best  describes  you? 

O  White 
O  Black 

O   Hispanic  (Mexican,  Mexican  American,  Chicano,  Puerto  Rican^  Cuban,  or 
other  Spanish  or  Hispanic  background) 

O  Asian  or  Pacific  Islander 

O   American  Indian  or  Alaskiiii  Native 

O   Other  (what?>   

3.  If  you  are  Hispanic,  what  is  your  Hispanic  background? 

O  I  fim  not  Hispanic. 

O  Mexican,  Mexican  Americart^  or  Chicano 

O  Puerto  Rican 

O  Cuban 

O  Other  Spanish  or  Hispanic  background 
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4,  How  often  do  you  usually  have  a  science  class  in  school? 

O    Every  day 

O    Several  times  a  week 

O    About  once  a  week 

O   Less  than  once  a  week 

O    Hardly  ever  or  never 

5,  Which  of  the  topics  listed  below  have  you  learned?    Fill  in  one  oval  on 
each  line, 

Haye  learned  Haye  not  learned 

How  to  add  O  O 

How  to  subtract  q  ^ 

How  to  multiply  Q  ^ 

How  to  divide  (^^  q 

What  fractions  are  O  O 

How  to  tell  time  Q  Q 


How  often  do  you  usually  have  a  mathematics  class  in  school 
O    Every  day 
O    Several  times  a  week 
O    About  once  a  week 
O    Less  than  once  a  week 
O    Hardly  ever  or  never 


0 
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GRADE  7 


GROUP  EXERCISES 


7S 


SECTION  1 


For  each  of  the  questions  that  follow,  fill  in  the  oval  next  to  the  ansver  you 
choose  • 

1.  Are  you  male  or  female? 

O  Male 
O  Female 

2.  Which  best  describes  you? 

O  White 
O  Black 

O   Hispanic  (Mexican,  Mexican  Americ^;n,  Chicano,  Puerto  Rican,  Cuban,  or 
other  Spanish  or  Hispanic  background) 

O  Asian  or  Pacific  Islander 

O   American  Indian  or  Alaskan  Native 

O  Other  (what?)   .  

3.  If  you  are  Hispanic,  what  is  your  Hispanic  background? 

O  I  ^  not  Hispanic. 

O  Mexican,  Mexican  American,  or  Chicano 

O  Puerto  Rican 

O  Cuban 

O  Other  Spanish  or  Hispanic  background 


Please  cominue  on  next  page.  ^ 
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4.  What  IS  the  raajn  thing  you  are  studying  in  science  this  year? 

O  I  am  not  studying  science  this  year. 

O  T>ife  science  (plants  and  animals) 

O  Physical  science  (maf:ter  and  energy) 

O  Earth  science  (weather,  rocks,  stars) 

O  General  science  (a  mixture  of  the  above) 

O  Other 

5.  Whet  kind  of  mathematics  class  are  you  in  this  year? 

O  I  m  not  taking;  m&thefcatics  this  year. 

O  Regular  mathematics 

O  Pre-algebra 

O  Algebra 

O  Other 


Please  contmue  on  next  page.  ► 
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6RADE  n 
GROUP  EXERCISES 
IIM 
SECTION  1 

For  each  of  the  questions  thst  follow,  fill  in  the  oval  next  to  the  answer  you 
choose . 

1.  Are  you  male  or  female? 

O  Male 
O  Female 

2.  Which  bej^t  describes  vqu? 

O  White 
O  Black 

O  Hispanic  (Mexican,  Mexican  American,  Chicano,  Puerto  Rican,  Cuban,  or 
other  Spanish  or  Hispanic  background) 

O  Asian  or  Pacific  Islander 

O  American  Indian  or  Alaskan  Native 

O  Other  (what?)  

3.  If  you  are  Hispanic,  what  is  your  Hispanic  background? 

O  ^  ^  not  Hispanic. 

O  Mexican,  Mexican  American,  or  Chicano 
O  Puerto  Rican 
O  Cuban 

O  Oi^her  Spanish  or  Hispanic  background 
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4.    Are  you  currently  taking  a  class  in  any  of  the  following  subjects?  Fill 
in  one  oval  on  each  line. 


Yea 

Ho 

Machemacics 

o 

o 

Science 

o 

o 

Computers 

o 

o 

5.    Counting  what  you  are  taking  now,  have  you  ever  taken  any  of  the  following 
mathematics  or  science  courses?    Fill  in  one  oval  on  each  line. 

Tea  Ho 

lUthoMtics: 

General  I  business  or 
consumer  mathematics 

Pre-algebra  or  introduction 
to  algebra 

First-year  algebra 

Second-year  algebra 

Geometry 

Trigonometry 

Pre-calculus  or  calculus 

Science: 

General  science 

Biology 

Chemistry 

Physics 
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PART  II 
HIGHER  ORDER  SKILLS  TASKS 


Introduction 

In  Part  II,  the  pilot -test  d  tasks  are  presented  individually.    The  Group 
tasks  are  presented  first,  followed  by  the  Station  Activities,  and  then  the 
Individually  Administered  Full  Investigations.    The  presentation  for  each  ^ask 
consists  first  of  the  task  as  the  students  saw  it;  followed  by  directions  for 
the  administrator  and  the  observation  checklist,  where  these  are  pertinent;  a 
description  of  the  apparatus;  the  scoring  guide  with  illustrative  examples  of 
each  score  level;  and  summary  corments  about  the  task. 

The  data  on  which  the  comments  are  based  included  student  performance  on 
each  task  by  grade  and  by  sex  and  the  correlation  coefficient  between  the 
number  right  on  the  mathematics  and  science  items  and  student  data  for  most  of 
t.ie  tasks.    Separate  analyses  by  sex  were  conducted  oO  determine  if  there  were 
any  obvious  gender  biases  in  the  tasks.    No  tests  for  significance  were  done 
on  -  ie  gender  results. 

Chapter  1  consists  of  the  group  e>:erc.ses;  Chapter  2  contains  the 
self-administered  station  activitias;  and  Chapter  3  contains  the  indvidually 
administered  full  investigations. 
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CHAPTER  1 
GROUP  EXERCISES 


Activity  Identification 

Whirlybi  rd  3,7 

Hair  Color  (Logic)  3 

Triathlon  3,7,11 

Number  Relationships  7,11 

Restaurant  7,11 

Heart  Rate  and  Exercise  11 
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GIUDE  3,7 


GROUP  EXERCISES 
3M 

SECTION  2 


Watch  as  the  teacher  does  the  experiment- 

Watch  the  "Whirlybird"  arm  carefully  each  time  until  it  stops. 

(1)  The  ball  bearings  were  put  in  the  two  outside  holes. 
The  "whirlybird"  arm  was  wound  up  exactly  three  timfs 
and  let  go. 

(2)  The  ball  hearings  were  put  in  the  next  two  holes.  The 
arm  was  wound  up  exactly  three  times  and  let  go. 

(3)  The  ball  bearings  were  put  in  the  next  two  holes.  The 
arm  was  wound  up  exactly  three  times  and  let  go. 

What  was  different  about  the  way  the  Whirlybird  armTiovedi 
when  the  steel  balls  were  in^the  different  holes?  \ 

(A)    Use  this  space  to  jot  down  notes  about  what  you  see 

HAPPEN   WHEN   THE   STEEL   BALLS   ARE   MOVED   TO  DIFFERENT 
HOLES? 


(B)    Use  this  space  to  write  down  your  answer  to  the  question 

IN   THE  BOX. 


7^ 


Activity  Identification;    Whi riybi rd 
Grade (s):  3,7 

Method  of  Administration:  Group  Activity 
Content  Area:  Science-Physics 


App 
vo  I 


aratus  required:  "Whirlybird"  apparatus,  6  ball  bearings  of  equal  mass  and 
volume,  spare  rubber  bands  and  a  spare  ball  bearing.    (See  picture  below.) 


Group  Activity-  3,7 

(to  be  read  by  the  A;) 

The  piece  of  equipment  in  front  of  you  is  called  a  Whirlybird.    This  part 
of  it  is  called  the  Whirlybird  arm  (A  should  point  towards  the  arm).    If  you 
look  at  the  arm  closely  you  will  see  that  It  has  three  holes  on  each  side. 


when 


I  am  going  to  put  the  steel  balls  on  different  holes  to  see  what  happens 
I  wind  the  arm  three  tines  and  let  go. 


When  I  have  finished,  I  ^»ill  ask  you  to  answer  the  question  on  the  paper 
in  front  of  you.    "What  was  differant  about  the  way  the  Whirlybird  arm  moved 
when  the  steel  balls  were  in  the  different  holes?" 


EKLC 


n  A 


Whirlybird 
Section  2  -  Group 
Grade  3M,  3S  -  fH 
7M,  7S  -  #1 

Look  what  happens  when  I  put  the  steel  balls  in  the  outside  pair  of  holes 
and  wind  the  arm  three  times.    Now  I  am  going  to  let  go  of  the  arm.  Katch 
carefully. 

Now  I  am  going  to  move  the  steel  balls  to  the  middle  pair  of  holes  and 
wind  up  the  arm  three  times.    Hatch  what  happens  as  the  arm  unwinds. 

Now  Tm  going  to  move  the  steel  balls  to  the  inside  pair  of  holes.  Watch 
carefully  as  the  arm  unwinds. 

I  am  going  to  do  the  experiment  all  over  again.    You  may  want  to 
jot  down  some  notes  about  what  you  see  happen  when  the  steel  balls  are  moved 
to  different  holes. 

(A  should  repeat  the  experiment  and  then  give  the  following  instructions.) 

Now  answer  the  question  in  front  of  you.    The  question  is  "What  was 
different  about  the  way  the  Whirlybird  am  moved  when  the  steel  balls  were  in 
the  different  holes?"    Think  back  on  how  the  Whirlybird  arm  acted. 


Score  3  p'cs.  for  a  response  that  accurately  describes  how  the  Whirlybird 
moved  in  relation  to  the  positioning  of  the  ball  bearings  in  tha  holes. 

Score  2  pts.  for  a  response  that  describes  how  the  Whi'^lybird  moved  but 
doesn't  specify  the  relationship  between  the  position  of  the  holes  and 
the  speed  of  the  Whirlybird  arm  (e.g.  It  moved  faster  the  second  time.). 

Score  1  pt.  for  an  incorrect  or  irrelevant  statement  about  vhat  happens 
as  the  ball  bearings  were  moved  to  different  holes. 

Score  0  for  no  response. 

Skills  involved: 


In  this  exercise  students  need  to  infer  a  relationship  between  two 
variables  based  on  their  observations. 


TniRD  Grade   vScore  ?om3 


(B)    Use  this  space  to  write  down  your  answer  to  the  question 

IN   THE  BOX. 


(B)    Use  this  space  to  write  down  your  amswer  to  the  oues^'  Ion 

IN  THE  BOX. 

\ 


■  ^vC5\}^j:>^     jj^CV^^lix  -^f^ny 


(B)    Use  this  space  to  write  down  your  ans';cEr  to  the  question 

IN  THE  BOX.  . 


SEVE^f^H  PRADE     ScORE  PoiNT  3 
InMe'IoX^^"         ""'^^  ^^""^  '^^^^^  ^°  QUESTION 

.-iMh^'  (h^  Ulf^  n^(^  ,nvi  -HiP  ,>vrn;^/C'A,/./^A  .//..^ 

Please  continue  on  next  page.  ^ 
ifriE'loX^^"         ""^^^  ^^"^  '^^'^^'^  ^°  QUESTION 


Please  continue  on  next  page. 


(D 


(B)    Use  this  space  to  write  down  your  answer  to  the  question 

IN   THE  BOX. 

\V    ^SACATS    i^sfer    oar3cf\  Viirne.  


Please  continue  on  next  page.  ► 


Third  Grade   Score  Point  2 


Use  this  space  to  write  down  your  answer  to  the  question 

IN  ^E  BOX* 

Jffii>    Pr^f^lAl  ^in/}r\  >  ,  ygj^  .  J(^r:tc^r 


Use  this  space  to  write  down  your  answer  to  the  ouestioi 
in  the  box* 


if  TjE'Lr"  "  ^O""  *"^«R  TO  THE  OUEST.ON 
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SEVE.NTH  Grade    Score  Point  2 


Use  this  space  to  write  down  your  answer  to  the  question 

IN   THE  BOX-  .  ^ 


Use  this  space  to  write  down  your  answer  to  the  question 
in  the  box. 


^jX>^   .M^mA  ityc^  ..^Jj:-  a^rsJ.  i^A^ 

.^LiDaJi  M/^  fuyr,/  gtf^  sClHir-   ^,j  ,-^jCr^ 


Use  this  space  to  write  down  your  answer  to  the  question 

IN  THE  BOX- 
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Third  ^rm?e   Score  Point  1 


KH)     USE  THIS   SPACE  TO  WRITE  DOWN  YOUR  ANSWER  TO  THE  QUESTION 
IN  THE  BOX. 


(B)    Use  this  space  to  write  down  your  answer  ro  the  question 

IN  the  box. 

Jsl^ — go        -To  ^jy.   \ .. 

 J 


(B)    Use  this  space  to  write  down  your  answer  to  the  question 
in  the  box. 
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Sevemth  Grade    Score  Point  1 


Use  this  space  to  write  down  your  answer  to  the  ■.i.^stion 

IN  the  box- 

yj);>^>V   cvi'^u»^A  ri9<i<^^-  ^^)cL±.  o%es^  

« 

fine     WciHiA  .  .  


\ 


Use  this  space  to  write  down  your  answfr  to  the  question 

IN  JHE  B0>{-        i    .         .  .  ^ 


Use  this  space  to  write  down  your  answer  to  the  question 
in  the  box. 
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Comments  on  Wh1r1yb1rd  (Grades  3  and  7) 

This  is  the  only  exercise  in  which  the  students  watched  a  demonstration 
by  an  administrator.    This  exercise  required  students  to  observe  what 
happoned,  interpret  their  observations,  and  report  their  conclusions.  The 
scoring  levels  attempted  to  differentiate  between  those  who  inferred  the 
relationship  and  made  it  explicit,  and  those  who  simply  reported  their 
observations.    The  performance  by  students  on  this  exercise  indicates  that  the 
task  is  appropriate  for  both  grades  3  and  7.    More  seventh  graders  than 
eleventh  graders  stated  the  relationship  between  variables  which  may  indicate 
a  developmental  difference.    There  was  little  difference  in  performance 
between  boys  and  girls. 

The  advisory  panel  expressed  some  concern  that,  given  the  wording  of  the 
question  and  the  order  in  which  the  demonstration  was  carried  out,  some 
students,  particularly  among  third  graders  who  scored  in  the  level  2  category, 
had  inferred  the  relationship  and  did  not  see  the  need  to  say  more  than  "it 
went  faster."    It  was  suggested  that,  for  future  use,  it  might  be  possible  to 
reword  the  question  to  try  to  elicit  the  explicit  statement  -f  relationship 
without  being  directive. 


GRADE  3 


Mary  and  Sue  are  two  young  girls. 

One  girl  has  blue  eyes  and  the  other  girl  has  brown  eyes. 
One  girl  has  brown  hair  and  the  other  girl  has  black  hair. 
Mary  has  blue  eyes. 

The  girl  with  brown  hair  does  not  have  brown  eyes. 

(A)  What  color  hair  does  Mary  have? 

(B)  Write  down  how  you  figured  out  your  answer. 
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Hair  Color  (Logic) 
Section  2  -  Group 
Grade  3M,  3S  -  //2 


A  &  B)  Score  4  pts.  for  the  correct  answer  -  brown  -  with  an  explanation 
that  uses  both  hair  color  and  eye  color. 

Score  3  pts.  for  a  correct  answer  with  an  explanation  that  uses 
either  hair  color  or  eye  color  but  not  both. 

Score  2  pts.  for  a  correct  answer  with  an  explanation  that  is 
irrelevant  or  erroneous  or  with  no  explanation  (i.e  no  response  in 
part  B). 

Score  1  pt.  for  an  incorrect  answer  with  or  without  an 
explanation. 

Score  0  for  no  response. 
Skills  involved; 

In  this  exercise  the  student  needs  to  uii3  transitive  reasoning  in  order 
reach  a  conclusion  about  given  information. 
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Third  Orade    Score  Point  'I 


(A)  What  color  hair  does  Mary  have? 

(B)  Write  down  how  you  figured  out  your  answer. 


(A)      W"AT   COLOR    HA!R   DOES   MaRY  HAVE? 


(B)    Write  down  how  you  figured  out  your  answer. 

I^<X^.  ^i^.JCrtxM^  jy&i    ACT    Af\JL  J^ixA 

Qj^f^  yx>y^  'TB-Vfcds  T^^Lwy. 

(A)    What  cai.Oi.  hair  l^oes  Mary  have? 


Write  down  how  yo 

LJ   FIGURED  OUT  ^ 

R  ANSWER.  / 

UvC.  tma/K  Actil^ 

Thi.rd  Grade   Score  Point  3 


(A)  What  color  hair  does  Mary  have? 

(B)  Write  down  how  you  figured  out  your.% answer.  / 

 ^Vn^    m'ir]     q]}'^     hrou^r)  hair 


(A)    What  color  hair  does  Mary  have?  ~^.TU^\,Tr^ 


(B)    Write  down  how  you  figured  out  your  answer. 


xxKsA^     .V/^^.^>0      \y^n\y\.)  . 


(A)    What  color  hair  does  Mary  have? 


(B)    Write  down  how  you  figured  out  your  answer 
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Third  Grade    Score  Poim-  2 

(A)  What  color  hair  does  Mary  have? 

(B)  Write  down  how  vou  figured  out  your  answer. 


(A)    What  color  hair  does  Mary  have? 


(B)    Write  down  how  you  figured  out  your  answer. 

(7 


(A)    What  color  hair  does  Marv  have? 

CB)    Write  down  how  you  figured  out  your  answer. 
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Comments  on  Hair  Color  (Grade  3) 


This  logic  problem  for  third  graders  worked  well  and  appears  to 
illustrate  what  the  API)  has  found;  namely,  that  students  are  more  likely  to  be 
able  to  do  problems  than  provide  good  explanations  for  their  answer  .  Over 
half  of  the  students  answered  correctly,  but  only  a  few  managed  co  offer  an 
explanation  that  took  both  hair  color  and  eye  color  into  account.  Sirls  in 
the  sample  performed  slightly  better  thafi  boys. 

Third  graders  seemed  to  understand  the  question  and  all  but  5  percent  at 
least  attempted  it,  The  advisory  panel  thought  that  this  exercise  could  be 
ysed  without  change  in  a  future  assessment, 
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GRADE  3,7, n 


3.    JoE^  Sarah^  Jos^^  Zabi^  and  Kim  decided  to  hold  their  own 
Olympics  after  watching  the  Olympics  on  TV.    They  needed  to 

DECIDE  what   events   TO  HAVE  AT   THEIR   OLYMPICS-      JoE   AND  JOS^ 
WANTED  A  WEIGHT   LIFTING  AND  A  FRISBEE   TOSS   EVENT-  SaRAH^ 

Zabi^  and  Kim  thought  a  running  event  would  be  fun-  The 

CHILDREN   DECIDED  TO  HAVE  ALL   THREE   EVENTS-     ThEY  ALSO  DECIDED 

to  make  each  event  of  the  same  importance- 

One  day  after  school  they  held  their  Olympics-  The 
children's  mothers  were  the  judges-    The  mothers  kept  the 
children's  scores  on  each  of  the  events- 

The  children't.  scores  for  each  of  the  events  are  listed 

BELOW: 

Chi  up'?  ':.:'M£       Frisree  Toss       Weight  I  ift       SQ-yard  dash 


Joe 
Aosk 

iCiM 

Sarah 

ZrtBI 


40  YARDS 
30  YARDS 
45  YARDS 
28  YARDS 
48  YARDS 


205  POUNDS 
170  POUNDS 
130  POUNDS 
120  POUNDS 
140  POUNDS 


9-5  SECONDS 

8-  0  SECONDS 

9-  0  SECONDS 

7-  6  SECONDS 

8-  3  SECONDS 


(A) 


Who  WOULD 


BE  THE  ALL-AROUND  WINNER? 


(B) 


Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


►  STOP 

....  .90 


Do  not  continue  until  told  to  do  so. 


Trlathelon 
Section  2  -  Group 
Grade  3M,  3S  -  it3 
7M,  7S  -  #2 
11M,11S  -  ifl 

Score  4  pts,  for  accurate  ranking  of  the  children's  performance  on  each 
event  and  citing  Zabl  as  the  overall  winner. 

Score  3  pts.  for  using  a  ranking  approach  to  evaluate  the  children's 
performance  but  misinterpreting  performance  on  the  dash  event  (l,e 
mistaking  longer  times  for  better  scores)  and  therefore,  citing  the  wrong 
child  as  the  overall  winner* 

Score  2  pts,  for  a  response  which  cites  an  overall  winner  or  a  tie 
between  children  with  an  explanation  that  demonstrates  some  recognition 
that  a  (Quantitative  means  of  comparison  Is  needed  to  choose  the  winner • 

Score  1  pt.  If  the  student  makes  a  selection  of  an  overall  winner  with  an 
Irrelevant  or  non-quantitative  comment  or  without  providing  any 
explanation. 

Score  0  for  no  response. 

Note  to  scorers:  Because  we  are  interested  more  in  the  students'  approach 
to  the  problem  than  their  accuracy  in  solving  it,  the  cases  in  which 
students  rank  accurately  but  add  incorrectly  or  misread  their  own 
notes  to  cits  Jose'  as  the  winner  should  be  scored  with  code  pt,  4, 

Skills  Involved; 

In  this  exercise  students  need  to  design  an  approach  for  evaluating  and 
interpreting  a  set  of  data. 
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Third  Grade    Score  Point  '4 

(A)  Who  would  be  the  all-around  winner? 

^  c^f^  A  

(B)  Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 

WINNER.      Be   sure   to   show   ALL/ your  WORK. 


0 


STOP    Do  not  continue  until  told  to  do  so. 
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Third  Grade    Score  Point  ^\ 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


lis 
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Seventh  Grade    Score  Point  4 
(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around  ^ 
WINNER.    Be  sure  to  show  all  your  work.  fm 

 .  Xn^cif^^  h^l^  e^ch    ^Pl'y.r^  cn^^j^.  ^ 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

Vrr^n-^  ^rsf    place  to  fiffK    pkre  ..T}^^i^ 


(A)    Who  would  be  the  all-around  winner? 


J  ; 


(B)    Explain  how  you  decided  who  would  be  the  all-around 

WINNER.    Be  .sure  to  show  all  your  work.  /7>. 

^^K^    r^rt   On^    JP^r^+         7  4. thirds  -  & 

v'<^S^    poi  n-ts 

.V    94  ^ 


Eleventh  Grade    Score  Point  4 


(A)    Who  would  be  the  all-around  winner? 

.■■'>><.■■•  f .  ^ 


© 


(B)    Explain  how  you  decided  who  would  de  the  all-around 
WINNER.  .Be  sure  to  show  all  your  work. 

■  t  ■ 

Timbered  eacn  p\ipr\^  Pra/v^  1-5  -  W  b<f6f  score  is 
^.  Ting  wftriv  o'l,  Tvi^vi  I  d66ctl       mu<^  dCores 

^Y)\On  u  Hit  V\y6V]fn  

(A)  Who  would  be  the  all-around  winner? 

"gAG  (  

(B)  Explain  how  you  decided  who  would  be  the  all-around  (if 
WINNER-    Be  sure  to  show  all  your  work-  ^ 

"THt  Oi^cE  T  6fi\/h    QPT.c  ^^on 

(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
winner.    Be  sure  to  show  all  your  work- 

7)"^'^/^^  r-'t^^  ^-hpfrs^  ^^^JpOmLlnh. 

each  p»S?ytZ-?  nw^n^  r^.  ^  f^.   9ahf  tmd 
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• 


• 


• 


Third  Grade    vScope  Point  3 
(A)    Who  would      the  all-around  winner? 


J. 


(B)    Explain  hOW  you  decided  who  would  e."  the  all-around 

WINNER.      BK   sure  to  SHOW  ALL   YOUR  WORK* 


(A)    Who  would  be  the  all-around  winn-r? 

^^hj  


(A)    Who  WOULD  be  the  all-around  winner? 
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(B)    Explain  how  you  decided  who  would  be  the  all-around 

winner.    Be  sure  to  show  all  your  work.  ^  y 


Seventh  Rrade    Score  Poii^  3 

(A)    Who  would  be  the  all-around  winner? 




(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

(A)    Who  would  be  the  all-around  winner? 




(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

hritftA  i  3.  it^/rir^  umi^  dii\rxjf\  ki: 

(A)  Who  would  be  the  all-around  winner? 

 To£  

(B)  Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

1-hf       V^nfs      TV)  ^K)   J:  rx  rk  d  ju^.  n\\ 


^-<^'\0       ^^^^'^^^   '^^^^^  sere  ^  ^ 


• 


El£VENTH  '"iiRADE     ScORE  PoiNT  3 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


(A)    Who  would  be  the  all-around  winner? 


3. 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 
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Third  Grade    Score  Point  2 

(A)  Who  would  be  the  all-around  winner? 

 (^Ji'vS/j^  

(B)  Explain  how  you  decided  who  would  be  the  all-around  ^ 
WINNER.    Be  sure  to  show  all  your  work.  fe) 

 <dL — rLiJ ^^Zr\{^>  /yrL(^^ 


(A)  .Who  would  be  the  all-arcun  ;  mnner? 

^TO  e>  


(B) 


Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  al;.,  your  work. 


nner.    be  sure  to  show 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 

WINNER.  Be  sure  to  show  all  your  work.  I 

.  V-/   -^J^ajL  /or^/yx 
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SEVErm  Grade   Score  Poimt  2 
(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


^-..y.    /'^v    ,u  ^'e^^? 


(A)    Who  would  be  the  all-around  winner? 

7.rx^v  


(B)    Explain  how  you  decided  who  would  be  the  all-around 

WINNER.     DE   sure  TO  SHOW  ALL   YOUR  WORK. 


(A)    Who  would  be  the  all-around  winner? 
 it,a^l^  b^-hhe  gjiyit^en  


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 
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Elevb^  Grade    Score  Pom  2 


(A)    Who  would  be  the  all-around  winner? 


\l  0 


(B)    Explain  how  you  decided  who  would  be  th''        around         /  _) 
WINNER.    Be  sure  to  show  all  your  work- 

yo^  Qerf  Zf^  //>f  ..  Nouj        you  Q  U^J-fA^'  V  //^  -^Jh^e  

ty  Ljk^<^  SO^r'C   <?>*^>^  -^If*^^  

(A)  Who  would  be  the  all-around  winner? 

 .  :  

(B)  Explain  how  you  decided  who  would  be  the  all-around 
wiNNbR.    Be  sure  to  show  all  your  work. 


-^^^-^CA)    Who  would  be  the  all-around  winner? 


Explain  how  you  decided  who  would  be  the  all-around 

WINNER.  Be  sure  to  show  all  your  work. 

  (MniAGJ  JjpHlk?. 

gj^^.               \  '  ("U^f  0!/Ua^-    o-v'^A^  uj^^Tt^ 


Third  'hrade    Score  Point  I 
(A)    Who  would  be  the  all-around  winner"? 

Z  Atfi.  


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

^  f  C  gftr.(?r)<^s  
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Seventh  Grade    Score  Point  1 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 


(A)      WH-O  would   be   the   all-around  WINNER? 


4^ 


(B)      EXPLATN   HOW  YOU    DECIDED   WHO   WOULD  BE   THE  ALL"AROUND 
WINMEK^      Be    SURE   TO   SHOW   ALL   YOUR  WORK. 


ERIC 


(A/    Who  would  be  the  all-around  winner? 

(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 
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Eleventh  Grade    Score  Point  1 


(A)    Who  would  be  the  all-around  winner? 


(B) 


w^M^Ji^  D1:CIDED  WHO  WOULD   BE   THE  ALL-.*-OUND 

WINNER.      Be   sure  to   show  ALL   YOUR  WORK. 


(A)    Who  would  be  the  all-around  winner? 


(b)    explak*  how  you  decided  who  would  be  the  all-around 
winner.    Be  sure  to  show  all  your  work. 


1^ 


5^ 

-2X 


1^ 


1^ 


(A)    Who  would  be  the  all-around  winner? 


(B)    Explain  how  you  decided  who  would  be  the  all-around 
WINNER.    Be  sure  to  show  all  your  work. 

did  j}\rtT.yjnn/^    /\  aJlX   
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Comments  on  Triathlon  (Grades  3,  7,  11) 

In  this  exercise,  which  was  tried  ou*:  at  all  three  grade  levels,  students 
must  decide  upon  an  approach,  and  interpret  the  data,  to  reach  a  conclusion 
about  the  results  of  three  athletic  events.    Further,  the  students  must  pay 
attention  to  the  tact  that  the  "lOwest  time  on  the  50-yard  dash  is  best 
although  the  highest  number  is  best  in  the  other  two  events.    Many  students  at 
each  grade  misinterpreted  what  was  best  on  the  dash;  almost  one-third  at 
grades  3  and  7  and  about  one-fifth  at  grade  11.    The  misuse  of  the  dash  was 
evidenced  in  a  variety  of  ways.    For  example,  some  students  ranked  accurately 
except  for  the  dash,  other  students  responded  "Joe  because  he  won  two".  In 
some  cases,  studencs  just  added  the  numbers  for  three  events  and  said  "Joe  won 
because  he  had  the  most  points." 

If  the  exercise  is  used  in  the  future,  the  score  range  should  be 
expanded  to  separate  those  students  who  said,  "Joe  because  he  won  two"  from 
the  others  now  classified  with  them  in  score  level  2.    The  potpourri  of 
approaches  used  by  other  students  currently  placed  at  score  level  2  are  very 
different,  including  such  methods  as  adding  incompatible  numbers,  adding  the 
frisbee  distance  to  the  pounds  lifted  and  subtracting  the  dash  time,  and 
taking  odd  averages.    The  scor^e  level  1  included  responses  of  no  winners  or 
multiple  winners. 

Although  the  task  was  very  difficult  for  third  graders,  several  attained 
scores  at  the  two  highest  score  levels.    It  may  be  appropriate  to  use  this 
exercise  for  all  grades  in  the  future,  particularly  since  the  data  shows 
development  differences  from  grade  3  to  7  to  11  in  the  percent  who  v;orked  out 
a  ranking  approach.    Almost  20  percent  at  grade  7  and  about  45  percent  at 
grade  11  used  a  ranking  approach.    There  was  a  wide  variety  in  how  this 
ranking  was  done,  including  ranking  participants  first,  second,  third,  etc.  in 
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each  event,  leading  to  lowest  score;  assigning  points,  such  as  5  to  first 
place,  to  each  place,  leading  to  highest  score;  and  finding  out  who  would  get 
the  most  medals,  as  in  the  Olympics, 

Although  there  is  little  difference  in  performance  on  this  task  between 
boys  and  girls  at  grade  3,  boys  appeared  to  have  less  difficulty  than  girls  at 
grades  7  and  11. 

This  exercise  is  recommended  for  future  use  with  two  minor  changes: 
substituting  parents  for  mothers  and  changing  the  heading  for  the  50-yard  dash 
to  TIME  FOR  50-YARD  DASH  as  a  small  clue  to  help  students  interpret  that  data. 


GRADE  7,  n 


3.    Below  are  two  columns  of  numbers.  A  and  B.    Begin  by  writing 
the  answers  to  the  multiplications  in  the  blanks  provided. 
Then  answer  the  questions  that  follow. 

A  1 

3x5=_  4x4=_ 

4x6=_  5x5  =  _ 

5x7  =  _  6x6=_ 

(A)    Look  for  the  patterns  in  A  and  B.    What  should  be  the 

NEXT  LINE    IN   EACH   OF  THE  COLUMNS? 

A  B 


(B)    Fill  in  the  numbers  in  column  A  that  would  be  on  the 

SAME   LINE   AS   THOSE   GIVEN    IN   COLUMN   B  BELOW. 

A  B 

  X          =    100  X  100  =  _ 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  column  B. 


(D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY   number  N. 
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Please  continue  on  next  page.  ^ 


Number  Relationships 
Section  2  -  Group 
Grade  7M,7S  •  #3 
11M,11S  -  #2 

a)  Score  2  pts.  for  correct  response: 

6x8-  48  7x7«49 
Score  1  pt,  for  an  incomplete  or  incorrect  response. 
Score  0  for  no  response. 

b)  Score  2  pts.  for  correct  response: 

99  X  101  «  9999         -  1000 
(acceptable  without  the  product  -  i.e*  99  x  101) 
Score  1  pt.  for  an  incorrect  response. 
Score  0  for  no  response. 

c)  Score  3  pts.  for  a  complete  or  accurate  explanation  such  as  The 
square  of  any  number  (or  any  number  multiplied  by  itself)  is  one  more 
than  the  product  of  the  numbers  one  less  and  one  more;     or  The 
product  of  two  numbers  that  differ  by  two  is  one  less  than  the  square 
of  the  number  between  them. 

Score  2  pts.  for  an  incomplete  explanation  that  is  correct  as  far  as 
it  goes  such  as  The  product  (answer)  on  the  left  is  always  one  less 
than  the  product  (answer  on  the  right);     The  answer  on  the  right  is 
always  one  more  than  the  answer  on  the  left;     The  numbers  on  the  left 
are  one  more  and  one  less  than  the  number  squared  (or  multiplied  by 
itself)  on  the  right. 

Score  1  pt.  for  an  incorrect  or  irrelevant  explanation. 
Score  0  for  no  response. 

d)  Score  2  pts.  for  a  correct  response  such  as: 

(n  "  l)(n  +  1)  -  n    -  J,    or  n  x  n  -1 

(n  "  l)(n  +  1)  +  1  «  n^  or  n  X  n 
Score  1  pt.  for  an  incorrect  response. 
Score  0  for  no  response. 

Skills  involved: 

In  this  exercise  students  need  to  infer  a  relationship  from  a  set  of 
numerical  patterns  and  express  this  relationship  in  a  generalized  form. 
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Seventh  Grade   Score  Point  1 


(A)    Look  for  the  patterns  in  A  and  B«    What  should  be  the 

NEXT   LINE    IN   EACH  OF  THE  COLUMNS? 


SEVErfTH  Grade   Score  Point  2 

(A)    Look  for  the  patterns  in  A  and  8-    What  should  be  the 

NEXT  LINE    IN   EACH   OF  THE  COLUMNS? 


ERIC 
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El£venth  Grade   Score  Poim-  2 


Eleventh  Grade  Score  Point  1 

Look  for  the  patterns  in  A  and  B-    What  should  be  the 

NEXT   LINE    IN   EACH   OF  THE  COLUMNS? 

A  £ 


liO 


Seventh  Grade   Score  Point  1 


(B)    Fill  in  the  numbers  in  column  A  that  would  be  on  the 

SAME   LINE   AS   THOSE  GIVEN    IN  COLUMN  B  BELOW. 


• 


Seventh  Grade   Score  Point  2 
(B)    Fill  in  the  numbers  in  column  A  that  would  be  on  the 

SAKE  LINE   AS   THOSE   GIVEN    IN   COLUMN  B  BELOW. 

3a  X  El  =  aaai        loo  x  loo  =  \^  ( 


» 


ERIC 
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Elevbith  Grade    Score  Pom  1  9ox-V 


(B)-   Ftll  in  the  numbers  in  column  a  that  would  be  on  the 

SAME  line  as  those  GIVEN    IN  COLUMN  B  BELOW- 

X  joi  =  i2?9  100  X  100  =  uroo 

Elevehth  Grade   Score  Point  2 
B)    Fill. in  the  numbers  in  column  A  that  would  be  on  the 

SAME   LINE  AS  THOSE  GIVEN    IN  COLUMN  B  BELOW- 

X  LL  =  35  100  X  100  =  1^00 
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vSeventh  Grade    Score  Poii^  3 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  column  B. 

(Dy^fc   IflSS-    ^\\r^frs  'H>os<t.  r^/u>^/^^.  ar\^^\r<: 


3 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B* 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B> 
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Eleventh  Grade    Score  Point  3 


(C)    Explain  the  relationship  between  the  equations  in  column 
A  and  column 


Jj^  hill        yVr  7^  '^/j^>^^!i^je,<^  -7^/7/  C^-^^ 

,r^<r- _      .   _   _.  ._  


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B. 


(C)    Explain. the  relationship  between  the  equations  in  column 
-  A  and  column  B. 
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$EVE^rTH  Grade    Score  Point  2 


(C)    Explain  the  relationship  between  the  equations  in  column 
A  and  column  B. 


(C)    Explain  the  relationship  between  the  equations  in  column 
A  and  column  B. 


(C)    Explain  the  relationship  between  the  equations  in  column 
A  and  column  B. 


A    >  A 
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Eleventh  Grade   Score  Poimt  2 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN   B»  ^^-^ 

4vve  ^'^"-^/^oC column       o-^fi  •  


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  column  B. 


Explain  the  relationship  between  the  equations  in  column 
a  and  column  b* 
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Seven™  Grade   Score  Point  1 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B- 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B- 

 Sncot  vmfi  ^  ihA  fr^ur^htr.^  art  /nulh^  /i/>d  t   

 f^^  m6  €r  6y  h)ficam  ^  num  b^r  


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B- 
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Eleventh  Grade    Score  Pom  1 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN'S- 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B- 


QM,   mjU)jLCK^    0»i  m-\Ji.    o<f^rVi  ti^ic  I 


(C)    Explain  the  relationship  between  the  equations  in  column 

A  AND  COLUMN  B- 
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Seventh  Grade    Score  Point  2 
(D)    Express  this  relationship  in  symbols  as  an  equation  for 

""""mUnn     column  6 

Please  continue  on  next  page.  ► 


(D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY  NUMBER  N. 


Please  continue  on  next  page.  ► 


(D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY  number  N.  q 

A  . 


Please  continue  on  next  page. 


119 


Eleventh  Givue    Score  Point  2 


(D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY  NUMBER  N- 

Please  continue  on  next  page.  ► 


D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY   NUMBER  N. 

Please  continue  on  next  page.  ^ 


D)    Express  this  relationship  in  symbols  as  an  equation  for 

ANY  NUMBER  N  ' 


■  (K/-i)xr!\)-*-i)=(v^-/) 


Please  continue  on  next  page. 
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SEVEmn  Grade    Score  Poim- 1 


Express  this  relationship  in  symbols  as  an  equation  for 
any  number  n- 


Please  continue  on  next  page. 


Express  this  relationship  in  symbols  as  an  equation  for 
any  number  n. 


Please  continue  on  next  page. ! 


Express  this  relationship  in  symbols  as  an  equation  for 
any  number  n. 


Please  continue  on  next  page. 
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Eleventh  Grade    Score  Point  1 


if  ^ 


Please  continue  on  next  page.  | 


I'l^^BETr """"""   "  -  -™ 


i:'iease  continue  on  next  page. 


N  X  N  =■  y 


Please  continue  on  next  page. 
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Comments  on  Number  Relationships  (Grades  7  and  11) 

This  mathematical  exercise  required  students  to  demonstrate  recognition 
of  a  pattern  in  Part  A,  then  to  extrapolate  it  in  Part  B,  determine  how  the 
two  equations  are  related  and  express  the  generalized  relationship  verbally  in 
Part  C,  and  symbolically  in  Part  D. 

This  exercise  appears  to  be  appropriate  for  both  grades  7  and  11. 
Seventy-six  percent  of  seventh  graders  and  94  percent  of  11th  graders  in  the 
sample  extended  the  pattern  one  step  in  Part  A,    Fewer  extrapolated  the 
relationship  to  100  x  100  in  Part  B.    Very  few  seventh  graders  successfully 
expressed  the  complete  relationship  in  Parts  C  and  D,  although  some  expressed 
part  of  the  relationship  in  Part  C.    As  a  group,  eleventh-grade  students 
performed  better  than  seventh-grade  students  on  all  parts  of  this  task.  There 
was  little  difference  between  the  performance  of  girls  and  boys  in  the  sample. 

Since  the  factoring,  n    -  1  ==  (n  +  1)  (n  -  1) ,  is  familiar  in  algebra 
classes,  it  was  important  to  make  sure  that  experience  with  algebra  was  not  a 
sufficient  condition  for  solving  the  problem.    Given  the  fact  that  more  than 
90  percent  of  the  eleventh  grade  sample  reported  having  taken  Algebra  1  and  77 
percent  reported  having  had  second  year  algebra,  and  only  18  percent  provided 
the  formula  or  its  equivalent  in  Part  D,  it  appears  that  the  exercise  requires 
thinking  beyond  the  routine. 

The  advisory  panel  recommended  this  exercise  for  future  use  with  one 
change.    They  suggested  that  Parts  C  and  D  be  combined,  giving  students  a 
choice  of  expressing  the  relationship  verbally  or  symbolically.    This  change 
would  not  require  pilot  testing  again. 
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GRADE  7,  11 


In  a  state  with  a  5%  sales  tax  on  restaurant  bills^  Alfredo' s 
restaurant  adds  a  15%  tip  automatically  to  the  food  cost  and 
then  adds  5%  of  the  total  for  tax- 

DmMINIQUE' S   RESTAURANT  ADDS  THE  5%  TAX  TO  THE   FOOD  BILL  AND 

leaves  the  amount  of  the  tip  to  the  patron* 

Suppose  two  groups  had  a  food  bill  of  $100^  one  at  each 
restaurant. 

(A)    The  customer  at  Dominique's  leaves  a  15%  tip  figured  on 

THE   FOOD  cost  PLUS   THE  TAX'      DoES  THE  CUSTOMER  IN 

Dominique's  pay  the  same^  more^  or  less  for  the  total 
bill  than  the  customer  in  Alfredo' s    for  the  same  food 

COST? 


(B)    Is  the  waiter's  tip  in  Dominique' s  the  same^  more^  or 

LESS   THAN  THE   TIP    IN  AlFREDO' S? 


(C)    If  the  customer  at  Dominique's  had  figured  the  tip  on 

THE  food  cost  BEFORE  TAX^  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME^   MORE^    OR  LESS? 
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Please  continue  on  next  page.  ► 
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Restaurants 
Section  2  -  Group 
Grade  7M,7S  -  iH^ 
1M,11S-  #3 

a)  Score  2  pts.  for  correct  answer  -  the  same. 
Score  1  pt.  for  Incorrect  answer. 

Score  0  for  no  response. 

b)  Score  2  pts.  for  correct  answer  -  more. 
Score  1  pt.  for  Incorrect  answer. 
Score  0  for  no  response. 

c)  Score  2  pts.  for  correct  answer  -  less. 
Score  1  pt.  for  Incorrect  answer. 
Score  0  for  no  response. 

Skills  Involved! 

In  this  exercise  students  need  to  extract  Information  from  written 
materials  In  order  to  reach  a  conclusion. 
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Semm  Grade    Score  Point  2 


The  customer  at  Dominique' s  leaves  a  15%  tip  figured  on 

THE   FOOD   COST   PLUS   THE  TAX.      DoES   THE   CUSTOMER  IN 
DoMINIQUF'I?    pay   the   same,    more,    or    LESS    FOR   THE  TOTAL 
BILL    THAN   THE   CUSTOMER    IN   AlFREDo' S      FOR   THE   SAME  FOOD 
COST? 

/0-Guff\^  


THE  CUSTOMER  AT  HnMINIQUE'S.  LEAVES   A  15%   TI.   FIGURED  ON 
THE   FOOD   COST   PLUS   THE  TAX-      DOES   THE   CUSTOMER  IN 
nOMTNIQUE's    PAY   THE   SAME,    MORE,    OR   LESS    FOR   THE  TOTAL 
BILL   THAN   THE   CUSTOMER    IN   Al  FREDO'S      FOR   THE   SAME  FOOD 
COST? 

•^^^   


The  customer  at  Domintquf's  leaves  a  15%  tip  figured  on 

THE   FOOD   COST   PLUS   THE   TAX-      DoES   THE   CUSTOMER  IN 
DQMir<IQHE'S   PAY  THE  SAME,   MORE,    OR   LESS   FOR  THE  TOTAL 
BILL   THAN   THE   CUSTOMER    IN   AlFREDO's      FOR   THE   SAME  FOOD 
COST? 
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Eleventh  Grade   Score  Pom  2 


The  customer  at  Dominique^s  leaves  a  15%  tip  figured  on  nV 

THE   FOOD  COST  PLUS   THE  TAX-      DOES   THE  CUSTOMER   IN  J-~^ 

Dominique", 5.  pay  the  same>  more^  or  less  for  the  total 

BILL  THAN  THE  CUSTOMER   IN  AlFREDO^S     FOR  THE   SAME  FOOD 
COST? 

r7->< 


The  CUSTOMER  at  DoMINIQDF^S  leaves  a  15%  TIP  FIGURED  ON 
THE   FOOD  COST  PLUS   THE  TAX.     DOES   THE  CUSTOMER  IN 

Dominique's  pay  the  same^  more^  or  less  for  the  total 

BILL  THAN  THE  CUSTOMER   IN  AlFREDO' S     FOR  THE   SAME  FOOD 
COST? 


The  customer  at  Dominiquf's  leaves  a  15%  tip  figured  on  --^^'^ 

THE   FOOD  COST  PLUS"  THE  TAX.      DOES   THE  CUSTOMER   IN  .  , 

DQMINIQlfF^<^   PAY   THE   SAME,   MORE,    OR   LESS   FOR   THE   TOTAL  A 
BILL   THAN   THE   CUSTOMER    IN  AlFREDo'^;      FOR  ^THE   SAME  FOOD 
COST? 
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Seventh  Grade    Score  Poii^rr  1  ■ 


(A)    The  customer  at  Dominique' s  leaves  a  15%  tip  figured  on 
the  food  cost  plus  the  tax.    does  the  customer  in 
Dominique's  pay  the  same^  more^  or  less  for  the  total 

BILL   than   the   customer    IN   AlFREDO' S      FOR   THE    SAME  FOOD 
COST? 


(A)    The  customer  at  Dominique' s  leaves  a  15%  tip  figured  on 

THE   FOOD   COST   PLUS   THE   TAX*      DoES   THE   CUSTOMER  IN 

Dominique' s  pay  the  same^  more^  or  less  for  the  total 

BILL   THAN   fHE   CUSTOMER    IN   ALFREDO' S     FOR   THE    SAME  FOOD 
COST? 


0 


(A)    The  customer  at  Dominique's  leaves  a  15%  tip  figured  on 

THE    FOOD   COST   PLUS   THE   TAX-      DOES   THE   CUSTOMER  IN 

Dominique's  pay  the  same,  more,  or  less  for  the  total 

BILL   THAN   THE  CUSTOMER    IN   Al  FRFDO's      FOR   THE    SAME  FOOD 
COST? 


& 

Wo  «^^t  -^Gu)  ckri-t  \y)eed.  ^  Pa^J  3  ^  'I" 


3t 
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(A) 


(A) 


Eleventh  Grade    Score  Point  1 
The  customer  at  Smij'^  ,  i„ 

toliUME^  P.V  THE  SAME,  MO.E,  OR  LESS,  POP  THE  TOTAL  'cS 
BILL^THAN   THE  CUSTOMER    ,N  AtFR^P0's_  POR  THE   SAME  ROOD 

t>CiVY\<r\iquvj  -  lea 

The   CUSTOMER  at   DommQMF^.  leaves  a  15%   TIP   PleURED  ON 
THE   POOD   COST   PLUS   THE  TAX.      DOES   THE  CUSTOMER  ,„ 

™E  MORE,    OR  LESS   POR  THE  TOTAL 

B^LL^THAN   THE   CUSTOMER    ■  N  ALOMfll^  POR  THE   SAME  POOD 


(A)    The  customer  at  Domintqi.f^<;  leaves  a  15%  tip  figured  o 

THE   FOOD  COST  PLUS  THE  TAX.      DOES   THE  CUSTOMER  IN 
DOMIr^IQ^;[=^«^   PAY   THE   SAME,    MORE,    OR  LESS   FOR  THE  TOTAL 
BILL   THAN   THE   CUSTOMER    IN   AlFREDO^S      FOR  THE   SAME  FOOD 
COST? 
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SEVE^rTH  Grade    Score  Point  2 


(B)      Is   THE  waiter's    TIP    IN   DoMINIcJUF's   THE   SAME.    MORE.  OR 
LESS   THAN   THE   TIP    IN  AlFREDO'?;? 


(B)      Is   THE  waiter's   TIP    IN   DoMINIQUE' S   THE   SAME.    MORE.  OR 
LESS   THAN   THE   TIP    IN  AlFREDO's? 


(B)      Is   THE  waiter's    TIP    IN   HoMINIQUE' S   THE   SAME.    MORE.  OR 
LESS   THAN   THE   TIP    IN  AlFREDO's? 


ERIC 
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Eleventh  Grade   Scope  Point  2 


(B)      Is  THE  waiter's  tip   IN  OOMrNlQUE' S   THE  SAME,   MORE,  OR 
LESS   THAN  THE  TIP   IN  AlFREDO'  S? 


(B)      Is   THE  waiter's   TIP    IN   DOMINIQIIF^^   THE   SAME,    MORE,  OR 
LESS  THAN  THE  TIP   IN  ALFREnn^R? 


(B)      Is   THE  waiter's   TIP    IN   DOMINIQIIF^R   THE   SAME,    MORE,  OR 
LESS  THAN  THE  TIP    IN  AlFREDoVr?  ^ 
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SEVENrm  Grade    Score  Point  1 


(B)      Is   THE   waiter's   TIP    IN   HoMINIQUE' S   THE   SAME,    MORE,  OR 

LESS   THAN   THE  TIP    IN  AlFREDO's?  H  V 

(^ysmc>re  or  ks5  ih-eh^  {67(?  S 


(B)      Is    THE  WAITER'S   TIP    IN  PQMINIQUF's   THE   SAME.    MORE,  OR 
LESS   THAN  THE   TIP    IN  ALFREPn's? 


(B)      Is   THE  waiter's   TIP    IN   DoMINIQUE's   THE    SAME,    MORE,  OR 
LESS   THAN   THE   TIP    IN  AlFREDO' S? 


ix-^.   Z3r  Aamte  an  how  much  -{i  p  ^ 
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ELEVB>n>i  Grade    Score  Poiwt  1 


(8)      Is   THE  WAITER'S  TIP   IN  mimmElA  THE  SAME.   MORE     OR  • 
LESS  THAN  THE  TIP   IN  )\LFR.nn'_.9  :  ' 


(B)      Is   THE 'waiter's   TIP   IN  DoM  I N  T  OIIF '      THE  SAME,   MORE,  OR 
LESS   THAN  THE  TIP   IN  AlFREDo's? 
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SEVEmU  f^RADE     ScORE  PoiNT  2 


If  the  customer  at  Domin ique' s  had  figured  the  tip  on 
the  food  cost  before  tax^  would  the  total  spent  be  thf 
same^  more^  or  less? 


If  the  customer  at  Dominique's  had  figured  the  tip  on 
the  food  cost  before  tax^  would  the  total  spent  be  thf 

SAMEy    MORE^    OR  LESS? 


If  the  customer  at  Domin ique' s  had  figured  the  tip  on 
the  food  cost  before  tax^  would  the  total  spent  be  thf 
same^  more^  or  less? 
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ELEVEffTH  fjRADE     SCORE  POIOT  2 

i 

(C)    If  the  customer  at  DoMiNrQUF\«^  had  figured  the  tip  on 

THE  FOOD  COST  BEFORE  TAX,  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME,   MORE,   OR  LESS? 


i 
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(C) 


If  the  customer  at  Dominipuf-.s  had  figured  the  tip  on 

THE   FOOD  COST  BEFORE  TAX,   WOULD  THE  TOTAL   SPENT  BE  THE 
SAME,    MORE,    OR   LESS?  ^ 

J 


(C)    If  the  customer  at  mimm^  had  figured  the  tip  on 

THE  FOOD  COST  BEFORE  TAX,  WOULD  THE  TOTAL  SPENT  H, 
SAME,   MORE,   OR  LESS? 

  ^S3 


13; 


^  Seventh  Grade    Score  Point  1 


(C)    If  the  customer  at  Dominique's  had  figured  the  tip  on 

THE  FOOD  COST  BEFORE  TAX^  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME^   MORE^   OR  LESS? 


(C)    If  the  customer  at  Domin ique' s  had  figured  the  tip  on 

THE  food  cost  BEFORE  TaX^  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME^   MORE^   OR  LESS? 


(C)    If  the  customer  at  Domin ique' s  had  figured  the  tip  on 

THE  food  cost  BEFORE  TAX^  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME^   MORE^   OR  LESS? 


ERIC 
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Eleventh  Grade   Score  Poiwt  1 


(C)    If  the  customer  at  DcntNIQilF^s  had  figured  the  tip  on 

THE  FOOD  COST  BEFORE  TAX.  WOULD  THE  TO-AL! SPENT  BE  THE 
SAME.   MORE.   OR  LESS? 


(C)    If  the  customer  at  J.ominiquf^s  had  figured  the  tip  on 
the  food  cost  before  tax.  would  the  total  spent  be  the 
same.  more.  or  less? 


(C)    If  the  customer  at  Dominique's  had  figured  the  tip  on 

THE  FOOD  COST  BEFORE  TAX.  WOULD  THE  TOTAL  SPENT  BE  THE 
SAME.   MORE.   OR  LESS? 
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Comments  on  Restaurant  (Grades  7  and  11) 

This  is  a  mathematical  problem  that  could  be  solved  by  logical  analysis 
with  an  understanding  of  percents,  or  by  actual  computation  of  percents  and 
comparison  of  results.    Although  it  was  assumed  that  seventh  grade  students 
would  have  learned  to  compute  percents,  the  computations  were  kept  simple  by 
using  $100  as  the  base.    However,  about  one-half  of  the  seventh  graders  did 
not  respond. 

Based  on  the  unsatisfactory  results  and  the  likelihood  that  there  would 
be  too  much  disparity  in  students'  experiences  with  restaurants  and  tips,  the 
advisory  panel  recommended  that  this  exercise  not  be  used  in  the  future. 
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GRADE  11 


Usually  your  heart  beats  regularly  at  a  normal  rate  when  you 
are  at  rest.    suppose  someone  asks  you  the  following 
QUESTIONS:    Does  your  heart  rate  go  up  or  down  when  you 
exercise?    how  much  does  your  heart  rate  change  when  you 
exercise?    how  long  does  the  effect  last? 

Think  about  what  you  would  do  to  find  answers  to  the 

QUESTIONS   ABOVE.      WhAT  TYPE  OF   EXPERIMENT  WOULD  YOU  DESIGN  TO 

answer  the  questions?    assume  that  you  have  the  following 
equipment  available  to  use:    an  instrument  to  measure  your 
heart  rate  such  as  a  pulse  meter^  a  stop  watch^  and  some 
graph  paper. 

Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 


►  STOP  Do  not  continue  until  told  to  do  so. 
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Heart  Rate 
Section  2  -  Group 
Grade  11M,11S  -  H 

1)  Pertains  to  scoring  for  the  experimental  design  (without  reference  to 
repeated  trials  which  is  scored  under  2), 

Score  6  pts.  for  all  essential  elements: 

Baseline  -  at  rest  heart  rate 
Timed  exercise 

Heart  rate  measo.red  immediately  after  exercise 

Repeated  measurement  of  heart  rate  over  course  of  time  until  normal 

(Note:  Acceptable  repeated  measurement  statements  include  those 
equivalent  to:  "..•continue  to  take  pulse  rate  until  normal.."    when  the 
student  has  indicated  that  the  pulse  meter  has  been  strapped  on  or 
attached  to  the  subject.) 

Score  5  pts.  for  noting  all  of  the  above  EXCEPT  that  the  post-exercise 
measurement  is  taken  only  after  a  specified  time  lapse  or  providing  a 
vague  post-exercise  statement  such  as  "..time  myself  until  normal." 
without  specifying  repeated  measurements* 

Score  4  pts.  for  noting  all  of  the  above  EXCEPT  that  exercise  isn't 
timed. 

Score  3  pts.  for  any  experiment  that  includes  baseline  measurements 
and  some  statements  (accurate  or  inaccurate)  about  two  other  variables 
of  the  experiment. 

Score  2  pts.  for  any  experiment  that  doesn't  include  a  baseline 
measurement . 

Score  1  pt.  for  an  irrelevant  or  meaningless  experiment  or  very 
incomplete  experiment  that  doesn't  go  beyond  exercise. 

Score  0  for  no  response. 

2)  Pertains  to  repeated  trials: 

Score  2  pts.  for  repeating  the  experiment  using  different  durations  of 
exercise. 

Score  1  pt.  for  any  other  indication  of  a  need  for  repetition. 
Score  0  for  no  mention  of  repetition. 
Skills  involved: 

In  this  exercise  students  need  to  design  a  reliable  experiment  to 
address  a  given  problem.     The  student  must  accomplish  this  by  first 
identifying  key  independent  and  control  variables. 
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Eleventh  Grade  Score  Point  6 

Briefly  describe  how  you  might  go  about  findi-ng  answers  to 
these  questions. 

 f-'vVS't^       n^eq^of?  »ny      hear)'    hiai'  tg^f-her 

S\^\v\a^     <^r     0,v\     hour  or    v^o/^  ,   "TVy\  heym  

pt.rCogtra»//v      cll^tki^J  ^of^e     z\}tr\^     Qy^lry,  q-fier, 

^Uo<Mys     ;)^^    ^^1^  rQ-f-p.  ^1.'^    q^bn>  fur^ 

Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 
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Eleventh  Grade    Score  Point  6 


Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 


(tfevetarcA  tY\Ufiu\sg^.  [vrry  )\ri 
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ELEve^  Grade   Score  Point  5 


Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 

Fng.sT,  Ta-^-s  s:^oMe^  Utg^y^  Bg^T  cr>^ 

1^  iM  T^-^p.    coiA^n^AJ  That  sr-^v<; 

■^(^leiM  .  Pur  -r^e    l-k^ycTR^-sr  Ti44t 

nOiNjurc^    ^cr  ^go\^o^^^^r^  ^^),o  t^Q/^^j 
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Elevbith  6rade    Score  Poiwt  5 


Briefly  describe  how  you  might  go  about  fiNomG  answers  to 

THESE  QUESTIONS.  (^mJi\Ui  1  (jr-t  1C    dO  fCPTf^ 

()T6i(jg  ripoi  heoY  before  oiera'^f  ^  Vi\nY\c m  arCLpr\ 

7)  (a  tLrv^^AjK/i.  T6V^    h^on  h^af> 

■  ^mt  ^eory  bm-  }nO]   oorse  down  f-o  r)(jryy\cdl. 

w  ^  ^  ^  


^  :i  Oil. 


1 — 


Briefly  describe  how  you  might  go  «        "inding  answers  to 
these  questions. 

o  y^<r     <ri-tAjit)L  •  

ERIC 


ERIC 


Eleventh  Grade   Score  Point  4 
Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions. 


4a 


Briefly  describe  how  you  might  go  about  finding  answers  to 


THESE  QUESTIONS. 


Briefly  describe  how  you  might  go  about  finding 


THESE  QUESTIONS. 


ANSWERS  TO 


EiEVEmn  Grade    Score  Point  3 

Briefly  oescribe  how  you  might  go  about  finding  answers  to 
these  questions. 


u 

9  c>tH^>^  ^"^Cl-Uu^d/) 


Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 


ma  nj^^  tx  jyi^^       Jtss^nt  -^A  or) 
c^ncxsA(L  .Jl.o\^  tyio  mini 
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Eleventh  Grade    Score  Point  3 


Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions.  * 

vKL)tr-^fr^  A>.r  (  y^Ai^  A^^r4- 


147 


ELEveiTH  Grade   Score  Point  2 


Briefly  describe  how  you  hight  go  about  finding  answers  to 


THESE  QUESTIONS. 


1  4-      '  ~^  ' 


 B.  r  —  r  ri   — i  e\.  i  j 


Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions. 

JOi/ryu?  . 


.g^j  .-.-^-.-^j^,^  ,0,^ 


Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  questions. 
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I  I 


Eleventh  Grade    Score  Point  1 


Briefly  describe  how  you  might  go  about  finding  answers  to 

THESE  QUESTIONS. 


-fKffI  j'^mhM  u-nn^M  ?r^cciS6  -T.r  ^  --5_M_rr^ 

rg.<>-j^Ar  nk)-JK  ^  ^^^^^^ 

Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions.  * 

— v-K.m  iri  Uvnrh   Hlai^r,,  "ttvi)  ^>vciix;fjLa, 


Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions.  ' 


7^  /p.n^^  "^{^  J'QP'"        ^        -  ^^^^^^^"^^-^ 
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Eleventh  Grade    Score  Point  1 


Briefly  describe  how  you  might  go  about  finding  answers  to 
these  questions. 

^  ^^^^^  v^^~^~^""  ■  ~ 

.^^eepS-  H^€L   ^(M-^e  -fir  \  m;n,  .  r^-sr  rtMP 
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Comments  on  Heart  Rate  and  Exercise  (Grade  11) 

This  exercise  assesses  the  ability  to  design  a  reliable  experiment  by 
identifying  the  key  independent  and  control  variables,  describing  how  they 
would  be  measured,  and  indicating  how  the  experiment  should  be  carried  out. 
The  problem  presented  here  was  originally  proposed  for  a  full  investigation. 
This  paper  and  pencil  task  was  included  as  a  prototype  for  ways  to  assess 
thinking  skills  in  oiological  contexts  which  pose  difficulties  for  actjal 
implementation  in  an  assessment. 

The  30  percent  of  the  sample  who  scored  0,  no  response,  or  1  may  have 
been  hampered  by  the  time  limits  because  this  was  the  last  group  exercise. 
Most  of  the  level  1  scores  were  for  very  incomplete  designs.    There  were  very 
few  meaningless  or  irrelevant  longer  designs. 

In  any  future  operational  use  of  this  task  cn  a  large  sample,  it  would  be 
desirable  to  revise  the  scoring  scheme  to  distinguish  some  categories  of 
response  that  are  now  combined.    For  example,  it  would  be  desirable  to 
separate  out  those  students  who  design  an  experiment  using  a  number  of 
subjects  at  the  same  time  and  those  who  take  their  own  pulse  rate  at  regular 
intervals  during  exercise.    Also,  some  means  should  be  devised  for  noting 
whether  or  not  the  graph  paper  was  used  and,  if  so,  whether  ^  meaningful  graph 
was  designed.    The  exercise  apparently  worked  well  and  about  one-fifth  of  the 
students  designed  an  experiment  including  all  essential  elements  and  controls. 
However,  very  few  mentioned  the  need  for  repeated  trials,  an  important  ele.iient 
in  a  reliable  experiment.    It  might  be  desirable  to  try  to  develop  a  single 
scoring  scheme  that  combines  both  parts. 

This  exercise  can  be  used  without  change  in  a  future  assessment.    It  is 
possible  that  it  would  be  appropriate  also  for  grade  7,  but  should  not  be  used 
at  that  level  without  pilot  testing.    Also,  this  exercise  can  serve  as  a 
prototype  for  other  tasks  requiring  design  of  an  experiment. 
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CHAPTER  2 

SELF-ADMINISTERED  STATION  ACTIVITIES 


Activity  Identification  Grade(s) 

Sorting,  Classifying 

Birds  (classify)  3 

Birds  (sort)  3 

Seeds  (classify)  3,7,11 

Seeds  (sort)  7 

Vertebrae  (sort)  11 

Observing,  Inferencing  and  Formulating  Hypotheses 

Sand  and  Tubes  3,7,11 

Rolling  Funnels  3,7,11 

Wig-Wag  3,7 

The  Circle  Game  3 

The  Numbers  Game  7,11 

Water  on  Brick  3 

Balance  Scale  7,11 

Double  Staircase  3,7,11 

Tubes  and  Capil laity  7,11 

Conductivity  11 

Interpreting  Data 

The  Gumball  Game  3,7,11 

Bubbles  3,7,11 

Magnet  and  Compass  11 

Designing  and  Conducting  an  Experiment 

Sugar  Cubes  7 

Magnets  (strength)  3 
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STATION  3 


Here's  what  you  do: 

1)     Write  down  three  ways  that  birds  A,  B,  and  C  are 
d  i  f f erent  • 


1. 
2. 
3. 


2)     Now  look  at  the  bird  labelled  D.     Does  bird  D  look  most 
like  bird  A,   bird  B,   or  bird  C  ? 


Explain  what  you  found: 

3)     Write  down  three  reasons  why  you  think  Bird  D  looks  most 
like  the  bird  that  you  have  chosen. 

1.  

2.  

3. 


ERIC 
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Activity  Identification:    Birds  (classify) 


Method  of  Administration:    Self -Administered  Station  Activity 
Content  Area:  Science-Biology 

Apparatu s  requ i red :    Four  pictures  of  birds  labelled  A,  B,  C,  and  D  that  are 
inidi vidua! ly  mounted  on  cardboard.    Birds  should  differ  in  morphology  (type  of 
legs,  beak,  size,  and  coloring). 

Administration:  Administrator  should  place  pictures  of  birds  in  front  of  the 
student  in  a  standardized  position. 

Servicing:    None  required 


Birds  (classify) 
Station  A 

Grade  3  -  station  3 


Scoring  of  the  Written  Responses 

1)  Score  1  pt,  each  starting  with  code  pt.  2  for  every  plausible  listing 
which  specifies  ways  that  birds  A,  B,  and  C  are  different.      Score  to  a 
maximum  of  the  three  best  responses. 

Score  1  pt.  If  the  student  provides  an  Irrelevant  response* 

Score  0  If  the  student  makes  no  response.     Responses  which  pertain  to 
Incidental  aspects  (e.g.,  spots  on  the  pictures)  should  not  be  scored* 

2)  Score  1  point  If  the  student  specifies  which  bird  that  bird  D  most 
resembles.     Score  0  If  the  student  makes  no  response. 

3)  Score  1  pt.  each  starting  with  code  pt.  2  for  every  listing  wh-^.ch 
specifies  ways  that  bird  D  resembles  the  bird  that  has  been  chosen.      Score  to 
a  maximum  of  the  three  best  responses.     Score  1  pt.  If  the  student  makes  an 
Irrelevant  response.     Score  0  If  the  student  makes  no  response.  Responses 
which  pertain  to  Incf.dental  aspects  should  not  be  scored. 

Skills  Involved 


In  this  exercise  the  student  is  asked  to  make  a  classification  of  an 
"unknown"  based  on  observations  about  a  set  of  stimuli.     In  order  to  make  this 
classification  the  etudent  must  make  comparisons  and  contrasts  among  the 
"known"  stimuli  (i.e.,  the  pictures  of  birds  A,  B,  and  C). 


ERIC 
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iHiRb  Grape    Score  Point  ^\ 


9^  \ 


i)     WRITE  DOWN  THREE  WAYS  THAT  BIRDS  A.   B.   AND  C  ARE 
DIFFERENT. 


1)    Write  down  three  ways  that  birds  A.       and  C  are 

DIFFERENT. 

1-    ^^^^^   h  X^/Z)   '  //ey,r0^py^  r.  '^v^^^ 


D^F^IreS?'  "^"^"^  AND  C  ARE 


156 


Th^w)  Grade   Score  ?om  3 


1)    Write  down  three  ways  that  birds  A.  B,  and  C  are 

DIFFERENT. 


1)    Write  down  three  ways  that  birds  A.  B,  and  C  are 

DIFFERENT 


1)    Write  down  three  ways  that  birds  A,  B,  and  C  are 

DIFFERENT. 


1-  — ^  ^^r^ 


2. 


-4,  o'.  1/^   f  n      I-  ^  ^ 


3-  _'tii£ir_i4A% 


ERIC 


Thik)  Cwe   Score  Point  2 


Write  down  three  ways  that  birds  A,       and  C  are 

DIFFERENT. 


D^JJereS^  '^^^  ^"^^  AND  C  ARE 


Write  down  three  ways  that  birds  A,  B.  and  C  are 

DIFFERENT.  ^ 


1. 

2. 
3. 


.0. 


■^^4^  cm 
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Third  Grade    Score  Point  1 


1-  vf'y^/^x  j^/^,^^ 


D^JJ^R^Sr  ;"J^^  ^^^^^"^^  A.   B.   AND  C  ARE 


2.  0  A'hu.  hs, 

3-  tj^^Zj2 


IV^llollV"  ^""'^  "^^^  ^"'^^  A.   B.   AND  C  ARE 


DIFFERENT 

3. 
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Third  ^rade    Score  Point  I 


Now  LOOK  AT  THE  BIRD  LABELLED  D.  DoES  BIRD  D,  LOOK  MOST  , 
LIKE  BIRD  A,   BIRD         OR  BIRD  C  ?    Jl^J^lj,  JJ^ 


'  c  r\ 


Now  LOOK  AT  THE  BIRD  LABELLED  D-  DoES  BIRD  D  LOOK  MOST 
LIKE  BIRD  A.   BIRD  B,   OR  BIRD  C  ?   ^  /\\ 
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THira)  GiVPE   Score  Point  '( 


9^  3, 


Write  down  three  reasons  why  you  think  Bird  D  looks  most 
like  the  bird  that  you  have  chosen. 


3.     g^p^  ^o'?^  ^^^-In^r^ 


I^ril^.^S^'^  REASONS  WHY  YOU  THINK  BiRD  D  LOOKS  MOST 

LIKE  THE  BIRD  THAT  YOU  HAVE  CHOSEN- 


i''?JI%Sp^Mn''^^  REASONS  WHY  YOU  THINK  BiRD  D  LOOKS  MOST 
LIKE  THE  BIRD  THAT  YOU  HAVE  CHOSEN. 

1-     6V^a^r~,  h^.,k  
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iHfii  Grade   Score  Point  3 


3)    Write  down  three  reasons  why  you  think  Bird  D  r qoks  most 

LIKE  THE  BIRD  THAT  YOU  HAVE  CHOSEN- 

A/t^  ^^^a  .  :  _ 

2-     ^Arnf/   "73^ 

3.      j^aA\.^  ,hJ^^^  


1. 
2. 

3. 


-Xhr^  bot-h  |qo3 


3)    Write  down  three  reasons  why  you  think  Bird  D  looks  most 
like  the  bird  that  you  have  chosen. 


1."    One      Oa^c)n  "Hvij^  ti 

'3.   \  Tn^'i/   /<D-/-A  A^t/^ 
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Thiw)  6r^e   Score  ?Qm  2 

3)    Writj  down  three  reasons  why  you  think  Bird  D  looks  mosj^ 
like  the  bird  that  you  have  chosen-  ""^^ 


HE  BIRD  THAT  YOU  HAVE  CHOSEN.  f 


3)    Write  down  three  reasons  why  you  think  Bird  D  looks  most 
like  the  bird  that  you  have  chosen- 


1. 
2. 

3. 


7^ 
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Third  'we    Score  Point  I 


Write  down  three  reasons  why  you  think  Bird  D  looks  most 
like  the  bird  that  you  have  chosen* 


Write  down  three  reasons  why  you  think  Bird  D  looks  most 

LIKE  the  bird  that  YOU  HAVE  CHOSEN- 


1-    inn  A   J.    lMx.  ..^   ..^j^i^  ju.  JnjiA 

2.      -A-r^J  A 


3. 


Write  down  three  reasons  why  you  think  Bird  D  looks  most 

LIKE  the  bird  that  YOU  HAVE  CHOSEN- 
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Comments  on  Birds(classify)  Grade  3 

For  the  first  part  of  this  exercise,  65  percent  of  the  students  compared 
and  contrasted  the  birds  and  specified  at  least  one  plausible  way  that  they 
were  different.    For  the  second  part,  about  45  percent  of  the  students  made 
the  best  classification  for  Bird  D. 

For  the  third  part,  again  about  65  percent  of  the  students  compared  and 
contrasted  the  birds  and  specified  at  least  one  plausible  way  that  they  were 
similar.  About  40  percent  of  the  students  discerned  more  than  one  plausible 
similarity. 

The  advisory  panel  and  the  administrators  agreed  that  the  exercise  was 
appropriate  for  third  graders.    It  provided  rich,  yet  manageable  stimuli  for 
students  to  make  comparisons  and  contrasts.    The  materials  also  are 
inexpensive,  as  well  as  very  easy  to  set  up  and  maintain.    This  exercise  would 
be  well -suited  for  any  future  national  assessment. 
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'".RADE  3 


• 


STATION  3 


Which  birds  go  together? 


Here's  what  you  do: 

1)    Write  the  letters  of  the  birds  that  go  in  the  two  ireeS' 
Something  must  be  thf  same  about  all  the  birds  in  each 

TREE. 

You  CAN  WRITE   THE  LETTERS   OF  THE  BIRDS    IN   EACH   OF  THE 
TREES. 


Tree  1 


Tree  2 


Explain  what  you  found: 

2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike. 

How  ARE   THE   BIRDS    IN   TrEE   1  ALIKE? 


How  ARE   THE   BIRDS    IN  TREF  2  ALIKE? 


ERIC 
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O 


Please  continue  on  next  page. 


3)     Now  PUT  DIFFERENT  BIRDS   TOGETHER   IN   EACH  OF   THE  TWO 
TREES. 

Something  m'ist  be  the  same  alout  all  the  birds  in  each 

TREL. 


Tree  3 

Explain  what  you  found: 


.REE  4 


4)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike* 


How  ARE   THE   3IRDS    IN  TrEE   3  ALIKE? 


How  ARE   THE   BIRDS    IN  "^REE  4  ALIKE? 
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Activity  Identification:    Birds  (sort) 
Grade(s):  3,7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:  Science-Biology 

Apparatus  required:    Seven  photographs  of  birds  labelled  A  to  fi  that  are 
individual ly  mounted  on  cardboard.    Birds  should  vary  in  morphology  (color  of 
breast,  beak,  size,  and  crest). 

Administration:    Administrator  should  place  the  photographs  in  front  of  the 
student. 

Servicing:  None  required 
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BlrdsCsort) 
Station  B 

Grade  3  -  station  3 

Scoring  of  the  Written  Responses 

1)  Score  2  pts.  If  the  student  Is  able  to  form  two  groups  of  birds  which 
Include  all  birds  and  no  repeats.    The  birds  In  each  group  must  be  matched  on 
one  of  the  four  relevant  cues  (color,  beak,  size,  and  shape).     Score  1  pt.  If 
the  student  either  repeats  or  doesn't  use  all  the  birds.     Score  0  If  the 
student  makes  no  response, 

2)  Score  1  pt,  starting  with  code  pt,  2  for  each  plausible  listing  of 
how  the  birds  In  each  group  are  alike  that  Is  consistent  with  how  the  student 
formed  each  group  In  1),     Score  1  for  an  Irrelevant  listing.     Score  0  for  no 
response, 

3)  Score  2  pts.  If  the  student  Is  able  to  form  two  new  groups  of  birds 
which  :llffer  by  at  least  one  bird  per  group  from  the  groups  formed  In  question 
1)  and  are  matched  on  one  of  the  relevant  cues*    These  groups  should  Include 
all  birds  and  no  repeats.     Score  1  pt.  If  the  student  doesn't  use  all  birds 
and/cr  makes  repeats.     Score  0  If  the  student  makes  no  response, 

4)  Score  1  pt,  starting  with  code  pt,  2  for  each  plausible  listing  of 
how  the  birds  In  each  group  are  alike  that  Is  consistent  with  how  the  student 
formed  each  group  In  3),     Score  1  pt,  for  an  irrelevant  listing.     Score  0  for 
no  response. 

Skills  Involved 

In  this  exercise  the  student  is  asked  to  form  groups,  each  based  on 
having  one  or  more  of  the  relevant  stimulus  attributes  in  common.     In  order  to 
form  these  groups  the  student  must  recognize  similarities  and  differences 
among  all  the  stimuli. 
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Third  Grade   Score  Pqint  2 

1)    Write  the  letters  of  the  birds  that  go  in  the  two  trees- 
Something  MUST  be  the  same  ABOUT  ALL  THE  BIRDS   IN  EACH 
TREE. 

You   CAN  WRITE  THE  LETTERS   OF   THE  BIRDS    IN   EACH   OF  THE 
TREES. 


Tree  1  Tree  2 

1)    Write  the  letters  of  the  birds  that  go  in  the  two  trles-  / 
Something  must  be  the  same  about  all  the  birds  in  each 

TREE. 

You  CAN  write  the  letters  of  the  birds  in  each  of  the 

TREES. 


Something  must  be  the  same  about  all  the  birds  in  each 


TREE. 

You  CAN  WRITE  THE  LETTERS  OF  THE  BIRDS  IN  EACH  OF  THE 
TREES. 


Tree  1  Tree  2 


Third  Grade   Score  Point  I  - 

1)    Write  the  letters  of  the  birds  that  go  in  the  two  trees- 
Something  MUST  BE  THE  SAME  ABOUT  ALL  THE  BIRDS  IN  EACH 
TREE. 

You  CAN  WRITE  THE  LETTERS   OF   THE  BIRDS    IN   EACH  OF  THE 
TREES.  . 


Tree  1  Tree  2 

1)    Write  the  letters  of  the  birds  that  go  in  the  two  trees- 
Something  must  be  the  same  about  all  the  birds  in  each 

TREE. 

You   CAN  WRITE   THE  LETTERS   OF   THE  BIRDS    IN   EACH  OF  THE 
TREES. 


Tree  1  Tppp  ? 
1)    Write  the  letters  of  the  birds  that  go  in  the  two  trees- 
Something  MUST  BE  THE  SAME  ABOUT  ALL  THE  BIRDS   IN  EACH 

tree. 

you  can  write  the  letters  of  t!,;'  y-rds  in  each  of  the 

TREES.. 


Tree  1  171  Tree  2 


• 


THiiRD  Grade   Score  Point  3 


2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike. 

How  ARE  THE  BIRDS    IN  TrEE  1  ALIKE? 


'9 


How  ARE  THE  BIRDS    IN  TrEE  2  ALIKE? 

Jll 


2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike. 


How  ARE  THE  BIRDS   IN  TrEE  1  ALIKE? 


■I 


How  ARE  THE  BIRDS   IN  TrEE  2  ALIKE? 


4) 


2)     Fill   in  the  SPAUts  bcuuw    iu  uca>^r<iDc  fijn    II. L.  ui.vL.^ 
EACH  TREE  ARE  AtSKE- 


How  ARE  THE  BIRDS   IN  ?f5EE  1  ALIKE? 


IN   f^EE  J.  ALIKE?  a  A 


ERIC 


How  AJ?E  THE  BIRDS    IN  TR£Ji  2  ALIKE? 
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Third  Grade   Scci^E  Poit^  2 

2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in  H^I' 

EACH  TREE  ARE  ALIKE- 

How  ARE  THE  BIRDS    IN  TrEE  1  ALIKE? 

TKe;  W<rAcs  i(^  .4t(>c>  f^Q  \m  ^Wk  Wo^c^  


How  ARE  THE  BIRDS    IN  TrEE  2  ALIKE? 


ERIC 


2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in  ^ 
each  tree  are  alike.  !  \  j-—' 

How  are  the  birds  in  Tree  1  alike?  / 

rt^9\J  all  -/cink  ^^///c  p  r xcpr 


How  are  the  birds  in  Tree  2  alike?  . 

rhpKi     n.Ji    ^^Iri    on  7d  tAe. 


2)  Fill  in  the  spaces  below  to  describe  how  the  birds  in  ' 
1      each  tree  are  alike* 

I      How  are  the  birds  in  Tree  1  alike? 

/!// 

How  ARE  THE  BIRDS    IN  TrEE  2  ALIKE? 

 f^r?"  ^  /  /      rr  ^      "  /  n       fine  cy  f  V3 
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Third  'irade    Score  Point  I 
2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 

EACH   tree  are  ALIKE. 

How  ARE   THE  BIRDS    IN  TrEE   1  ALIKE? 


How  ARE  THE  BIRDS    IN  TrEE  2  ALIKE? 


2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 

EACH  tree  are  ALIKE- 

How  ARE   THE  BIRDS   IN  TrEE  1  ALIKE? 

C^L^hQ^  -i-fk(?r^j    l//rr=W)^  /  IrrJ^^yu^y 


HOV;  ARE  THE  BIRDS   IN  TrEE  2  ALIKE? 


2)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike- 

How  are  the  birds  in  Tree  1  alike? 


How  ARE  THE  BIRDS   IN  TrEE  2  ALIKE? 
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Third  Grade   Score  Point  2 


2^  Something  must  be  the  same  about  all  the  birds  in  each 


TREE. 


Tree  4 


f)  Something  must  be  the  same  about  all  the  birds  in  each 

TREE. 


Tree  ^ 


3} 


Something  must  be  the  same  about  all  the  birds  in  each 

TREE. 


0 
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Tree  4 


Third  Grade    Score  Point  I 


3\  Something  must  be  the  same  about  all  the  birds  in  each  I 

J    TREE.  1 


Tree  3 


Tree  4 


5^    SoMETHINo   MUST  BE  THE   SAME  ABOUT  ALL  THE  BIRDS    IN  EACH 


TREE' 


Tree  4 


?\  Something  must  be  the  same  about  all  the  birds  in  each  / 
/   tree.  ' 


I 


ERIC 


0 

Tree  3 
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Third  Grade   Score  Point  3 


4)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 

each  tree  are  alike*  ^ 

Mow  are  the  birds  in  Tree  3  alike? 


How  are  the  birds  in  Tree  4  alike?  a  (l 


4)    Fill  in  .hE  spaces  below  to  describe  how  the  birds  in  « 
each  tree  are  alike. 

How  ARE  THE  BIRDS    IN  TrEE  3  ALIKE? 


How  ARE  THE  BIRDS    IN  TrEE  4  ALIKE? 


4)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 

EACH  tree  are  ALIKE* 

How  ARE  THE  BIRDS    IN  TrEE  3  ALIKE? 

Thfy  ail  hnue.  prsj^^^A  b^,/i<C: 

Ktsck    -^^'7  oil  ha\H     (X  I.'-/'  -/  /  p 


3' 


How  ARE. THE  BIRDS    IN  TrEE  4  ALIKE? 


?OuA  H 

Thi'rt)  «3rade   Score  Pqint  2 

^)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike. 

How  ARE  THE  BIRDS    IN  TrEE  3  ALIKE? 


How  ARE  THE  BIRDS    IN  TrEE  ^1  ALIKE? 


^)    Fill  in  the  spaces  below  to  describe  how  the  birds  in  • 
each  tree  are  alike-  ) 

How  ARE  THE  BIRDS    IN  TrEE  3  ALIKE? 


How  ARE  THE  BIRDS    IN  TrEE  ^1  ALIKE? 


^)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 

HACK  T^EE  are  alike. 
^  How  ARE  THE  BIRDS    IM  TrEE  3  ALIKE? 


How  ARE  THE  BIRDS    IN  TrEE  ^  ALIKE? 


Third  'irade    Score  Point  I 


4) 


EAc'h  I^ErLrAUKEf'^^'         ''''''''  '^'^^ 


How  ARE  THE  BIRDS    IN  TrEE  3  ALIKEx? 


■  t  :>  ALIKE^'' 


4)    Fill  in  the  spaces  below  to  describe  how  the  birds  in 
each  tree  are  alike- 

How  ARE  THE  BIRDS    IN  TrEE  3  ALIKE? 

•   


How  ARE  THE  BIRDS    IN  TrEE  4  ALIKE? 


4)    Fill  in  the  spaces  below  to  describe  how  the  birds  in  i 

EACH  TREE  ARE  ALIKE-  / 
How  ARE  THE  BIRDS    IN  TrBE  3  AL,IK£? 


How  ARE  THE  BIRDS    LN  TrEE  4  ALJKE? 

 cTZ^y  ^  a//Aj.    A^j^^j^^a  ,  'yt^,^.- 
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Comments  on  Birds (sor^)  Grade  3 

In  the  Birds(sort )  exercise,  plausible  groups  of  oirds  could  be  forn??d  by 
matching  birds  on  color,  beak,  size,  or  shape.    To  form  groups,  students  would 
have  to  understand  the  problem,  observe  the  birds'  similarities  and 
differences,  and  explain  the  basis  for  their  groupings.    Although  60  percent 
of  the  students  formed  two  groups  of  birds  which  included  all  the  birds  and  no 
repeats,  only  21  percent  accurately  described  how  just  one  of  their  groups 
were  alike  and  only  22  percent  accurately  described  how  both  of  their  groups 
^e  alike. 

For  the  third  and  fourth  questions,  students  were  asked  to  resort  the 
birds  to  form  two  new  groups  each  based  on  rew  characteristics  and  then 
describe  the  similarities  of  the  birds  in  each  of  their  new  groups.  About 
one-third  generated  a  different  sorting,  and  one-fifth  described  how  the  birds 
in  at  least  one  of  their  new  groups  were  alike. 

The  advisory  panel  and  the  administrators  agreed  that  the  exercise  needed 
additional  work.    The  administrators  reported  that  many  students  did  not 
understand  how  to  place  the  birds  into  trees  and  were  confused.    A  suggested 
rewording  was:    "Which  birds  go  together?    Which  would  you  put  in  group  1  and 
which  would  you  put  in  group  2?" 

Another  problem  with  the  exercise  was  that  the  colored  drawings  were  too 
small.    Larger  colored  photographs,  such  as  those  used  in  Birds(classify) , 
would  be  better  stimuli  for  this  exercise. 

In  spite  of  these  problems,  the  exercise  did  show  that  some  students 
could  understand  the  directions  and  could  sort  the  birds.    The  panel  liked  the 
idea  of  a  sorting  exercise,  but  recommended  that  this  exercise  be  revised 
based  on  better  stimulus  materials  and  directions  that  eliminated  the  trees. 
If  the  exercise  is  revised,  it  would  have  to  be  pilot  tested  before 
operational  use. 
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GRADE  3 


STATION  6 


What  is  the  same  about  the  seeds  in  each  group? 


Here's  what  you  do: 

1)  Look  carffully  at  the  two  groups  of  seeds-    You  may 
smell  them  and  pick  them  up  but  do  ijot  taste  them- 

2)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1. 


3)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  2* 


^)      Now   LOOK   AT  THE   SEED   LABELLED  X-      WhICH   GROUP   WOULD  YOU 

PUT  IT  IN?    Write  down  why  you  think  seed  X  belongs  in 

THE   GROUP   YOU   HAVE  CHOSEN. 
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GRADES  7,11 


STATION  3 


What  is  the  same  about  the  seeds  in  each  group? 


Here's  what  you  do: 

1)  Look  careful:. y  at  the  three  groups  of  seeds.    You  may 
smell  them  and  pick  them. up  but  do  not  taste  them. 

2)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  !• 


3)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  2. 


4)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  3. 


5)  Now  look  at  the  seeds  labelled  X  and  Y. 

6)  Write  down  why  you  think  each  of  the  two  seeds  belongs 
IN  Group  1,  2,  or  3. 

Seed  X   


Seed  v 
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Activity  Identification:    Seeds  (classification  of  unknown) 


Grade(s):  3,7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Sci ence-Bi ol ogy 

Apparatus  required:    Containers  filled  with  samples  of  labelled  but  unnamed 
seeds:    A  =  caraway  seeds,  B  =  cumin  seeds,  C  =  black  peppercorns,  D  =  millet 
seeds,  E  =  fennel  seeds,  F  =  all  spice,  R  =  white  peppercorns,  "  =  yellow 
mustard  seeds,  J  =  fenugreek  seeds,  X  =  coriander,  Y  =  ;)arley.    For  the  grade 
3  students,  only  groups  1  and  2  will  be  used. 

Administration:    Seeds  should  be  placed  into  the  following  groups:  Group  1^ 
a,B,E;  Group  2=  C,F,G;  and  Group  3=  D,H,J.    For  the  grade  3  students  only 
groups  1  and  2  and  the  unknown  X  should  be  set  up.    For  the  remaining 
students,  all  three  groups  and  both  unknowns  should  be  set  up.    Seeds  should 
be  replaced  if  their  level  in  each  dish  appears  low  at  the  end  of  an 
administration.    Seeds  should  be  placed  back  into  groups  after  every 
administration. 

Servicing:    None  required 


V'.  ■ .  : 
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Seeds  (classification  of  unknown) 
Stations  A  &  B 
Grade  3  -  station  B6 
7  -  station  A3 
11  -  station  A3 

Scoring  of  the  Written  Responses 

(for  grade  3) 

2-3)  Score  1  pt.  starting  with  code  pt,  2  for  each  accurate  or  plausible 

statement  about  how  the  seeds  in  each  group  are  the  same«     Score  to  a 
maximum  of  the  three  best  responses  per  group*    Score  1  pt,  if  the 
student  provides  an  inaccurate  or  irrelevant  response*     Tae  attribute 
of  smell  should  be  scored  as  an  irrelevant  response,  0  if  the 

student  makes  no  response* 

4)    Score  1  pt.  starting  with  code  pt,  3  for  each  accurate  or  ...asible 
statement  about  why  the  student  placed  seed  X  in  a  given  g«:  (i,e, 
Seed  X  was  the  same  size  as  the  seeds  in  Group, •,)•     Scort   -     I  a 
maximum  of  the  three  best  responses*     Students  should  plr^c?  !. «  ad  X 
with  Group  2*     Score  2  pts»  for  providing  a  group  only*     Sca/^?,  pt, 
if  the  student  provides  an  inaccurate  or    irrelevant  respOi'\ae,  The 
attribute  of  smell  should  be  scored  as  an  irrelevant  response,  Score 
0  if  the  student  makes  no  response* 

(for  grades  7  &  11) 
2-4)    Score  1  pt,  starting  with  code  pt,  2  for  each  accurate  or  plaTisible 
statement  about  how  the  seeds  in  each  group  are  the  same.     Score  up 
to  a  maximum  of  the  three  best  responses  per  g/oup.     Score  1  pt ,  if 
the  student  provides  an  inaccurate  or  irrelevant  response^  The 
attribute  of  smell  should  be  scored  as  an  irrelevant  response.  Scove 
0  if  the  student  makes  no  response, 

6)    Score  1  pt.  starting  with  code  pt,  3  for  each  accurate  or  defensible 
statement  about  why  the  student  placed  "'^edr,  T  and  Y  in  ^.  sivan 
group.     Score  up  to  a  maximum  of  the  Cdi'ee  best  r^esponses  for  seed  X 
and  for  seed  Y,     Scoreable  response.    i:cr  Seed  X  would  include 
placement  with  Group  2  because  of  k',:^*  md  shap.'  or  placement  with 
Group  3  because  of  color  and  shape.     Scoreable  responses  for  Seed  Y 
would  include  placement  with  Group  I  because  of  shape  ar  1  size  or 
placement  with  Group  3  because  of  color  and  shape.     Score  2  pts,  if 
the  student  provides  a  group  without  providing  an  explanation. 
Score  1  pt.  for  an  inaccurate  or  irrelevant  response.     Tl*ie  attribute 
of  smell  should  be  scored  as  an  irrelevant  response.     Score  0  if  the 
student  makes  no  response. 

Note:  Texture  and  hardness  are  scoreable  attributes. 

Group  1:  (A,B,E)  caraway,  cumin,  fennel 

Group  2:  (C,F,G)  black  peppercorns,  allspice,  white  pepperrorns 
Group  3:  (D,H,J)  millet,  yellow  mustard,  fenugreek 
Unknown  X:  Coriander      Unknown  Y:  Barley 
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Skills  Involved 

In  this  exercise  students  are  requJred  to  classify  an  "unknown"  based  on 
a  set  of  generalizations  about  a  set  of  "known"  entitles.  The.ve 
generalizations  are  made  by  making  a  set  of  comparisons  and  contrasts  about 
the  set  of  known  entitles. 
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ERIC 


THi.RD  Grade   sScore  ?om  3 

2)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1» 

 ■  

3)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  2. 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1. 

Jkr}sr  nUj  Utuj  /c/i//.,  ij/u   

5)    Write  down  what  you  think  is  the  same  about  the  seeds  in 

i^RJUP  2. 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  !• 

they  are   c{i\    poinfed  '  


3)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  2» 


ih^y  qf€  ail  rofJVlcl 
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Seventh  Grade    Score  Point  6 


9o^3  a-  H 


2)    Write  down  what  you  think  is  the  same-about  the  sf  ds  in 
Group  1.  ^      ,  ;       ^^kft'^t.^      ,  ' 

Group  2°^^^  ""'^^        ^"^'"^  ^^^^  ^^^^^ 

4)    Write  down  what  you  think  is  the. same  about  the  seeds  iwC (Z^ 


p  5  to 

^^^jj^^^  ^^^^^^^^^^^^^^^^^^^^  • 


Group  3- 


Seventh  ^^rade    Score  Point  8 

2)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  - 

^■^-Cr-  rlfFf^r-fn-r  C9ffr^.  ±h<^  all  h^v>^-    ///n<^_<  Sain^ 

3)  Write  down  what  you  think  is  the  same  about  the  seedt  in  rrif^/tfirA/. 
Group  2.  • 

rhr.V|  gr-ft  flJJ  ha  U  ^Ua^t     t^-^*^  a /I  \ 

/✓I  Colcr, 

4)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  3. 

l; 

Th-C^  rir-cr  ftJi  V^-^^  iiixLjL^__iiJ:iA__ZL^^fciifl_ 
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Eleventh  Grade    Score  Poii^n-  7 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1. 

5^    Group  2°^^  ^"'^^        ^"'^"^  ^^^^ 


4)    Write  down  what  you  think  is  the  same  about  the  seeds  in 

faROUP  D' 


Eleventh  Grade    Score  Point  9 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1. 

5^    Group  2°^^  ^"'^^        ^^^^^  same  about  the  seeds  in 


Group  3°^^^  ^"'^^        ^"^^"^  ^'^^^  ' 


Third  Grade    Score  Point  2 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1- 


3)    Writf  down  what  you  think  is  the  same  about  the  seeds  in 

Group  2-  ^ 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 


3)     WrITF   down  what  you  think   is  the  same  about  the  seeds   in  'O 

Group  Z.  «  A  a  /• 


2)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  !•  v 

ere-    o\\      tO'ieCcA     \\\^  \c  nk 

3)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  2.  i       I  \ 


ERIC 
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SEVEfiTH  Grade   Score  Point  2 


GroIp  iT"*  ^"^"^         ■'"^  ^^"^  ABOUT  THE   SEEDS  IN 

GrJIp                               '"^'^^                 SA^^  ABOUT  THE  SEEDS  IN 
-±V^   ail     OOiiVN/^  f  2^ 


.GrJIp  3?"'  ''''''           '"^'^                 SAME  ABOUT  TH^E  SEEDS  IN 
^-^^     ^r^oW    ^V\-Q<>j  <knjTf\a.  

Seventh  Grade    Score  Point  4  — 

Gr^Jp  ^"^^^   ^S   THE   SAME  ABOUT  THE  SEEDS  IN 

GrJIp  2?"'                                               SAME  ABOUT  THE  SEEDS  IN 
 fl^ii  oiJ^        A>>^>i  jLxijg^  

4)     WRITE  DOWN  WHAT  YOU  THINK    IS  THE  SAME  ABOUT  THE  SEEDS  IN^ 
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• 


Third  Grade    vScore  Point  1 


2)    Write  down  what  you  think  is  the  same  about  the  seeds  in  / 
Group  !•  I 


3)    Write  down  what  you  think  is  the  same  about  thp  seeds  in 
Group  2« 


Gr^Jp  1?"^  ^^^'^        ^"^'"^  seeds  in 

gr^Ip  2?"''  "^"'^     ^"^^"^       ^^^^         s^^°s  IN  y 


Gr^Ip  1?^^  ^"^^  '^'^^^^  ^"'^   SEEDS  IN 

^'     GwJp  2T  ""''^  ™E  SEEDS  IN 


ERIC 
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Eleventh  Grade    Score  Point  1 
^         2)    Write  down  what  you  think  is  the  same  about  the  seeds  in 


Group  T.^^  ^"'^^        ^"'^"^      ^"^^  ^''^^ 
rTi-eJixjtvr,  ^ai^J  Cg^  c^re  r^^y  


2)    Write  down  what  you  think  is  the  sam.  about  the  se?ds  in 
Group  1. 


Eleventh  Grade    Score  Point  3 


3)    Write  down  what  you  think  is  the  sahe  about  the  seeds  in 
Group  2. 


4)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  3- 

synP^  ' —    Eleventh  ^^rade    Score  ^oint  5 

2)  Write  down  what  yuu  ihink  is  iMb  bAnb  abuui  inE  seeds  in 

Group  1. 

Nj^yA>>  ^  .  

3)  Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  1' 

1^)    Write  down  what  you  think  is  the  same  about  the  seeds  in 
Group  3. 


Thi>j)  Grade   Score  Point  3 

Now  LOOK  AT  THE  SEED  LABELLED  X-     WhIc  '  GROUP  WOULD  YOU 

PUT   IT   IN?     WRITE  DOWN  WHY  YOU  THINK  SEED  X  BELONGS  IN 

THE  GROUP  YOU  HAVE  CHOSEN-    '  ^ 


Now  LOOK  AT  THE  SEED  LABELLED  X.     WhICH  GROUP  WOULD  YOU 

PUT  IT  IN?   Write  down  why  you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN. 


Now  LOOK  AT  THE 


D..T  Tx  T«o  \jr.-rJ^^^  LABELLED  X.  Which  group  would  you 
PUT  IT  IN?   Write  down  why  you  think  seed  X 


the  group  you  have  chosen. 


BELONGS  IN 


1 !  ha^A 

3 
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SEVErfTH  Grade    Score  Poiwt  2 


5)  now  look  at  the  seeds  labelled  x  and  y* 

6)  Write  down  why  you  think  each  of  the  two  seeds  belongs 
IN  Group  1^  2,  or  3. 


Seed  y  \\   ■5\V>g)\'^  AVg    ^rY^(»  qS 


Seed  X        ^t/^p\\5   aacI    \no\^S  VV^Q<  '^O.^yie  ciS 
^^Tqi/^^  1:   


Sevekth  Grade  '  Score  Point  4 

5)  Now  LOOK    ?.T  the  seeds  labelled  X  AND  Y. 

6)  Write  down  nHv  you  think  each  of  the  two  seeds  belongs 
IN  Group  1^  ;  .  or  3. 

Seed  X  M-  ,Mre^^   ^  Hu^y?  D    JUu^^lc^    7i  Lt 


Seed  Y  JU  I 


Seventh  Grade    Score  Point  6 

5)  Now  look  at  the  seeds  labelled  X  and  y. 

6)  Write  down  why  you  think  each  of  the  two  seeds  belongs 
IN  Group  1^  2,  or  3. 


Ur<  hna — in  2:ii=e  ^'^rl  -fi^-A    \ft\-^^  rvnninc 

th^v^       r^r-C>  Ujt±t£^  fe/^l/c  ^r-^. 
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Third  Grade   Scbhe  Point  2 


Now  LOOK  AT  THE  SEED  LABELLED  X-      WhICH  GROUP  WOULD  YOU 

PUT  IT  IN?    Write  down  why  you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN. 


fi^^u^  all 


DM?   tS^'Jk.?^  I"^  LA-.FLLED  X-      WhICh"  GROUP  WOULD  YOU 

PUT  17  IN?    Write  down  m    you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN- 


SEED  LABELLED  X-     WhICH  GROUP  WOULD  YOU 

PUT  IT  IN?    Write  down  why  you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN-  .  «.o  in 
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Elevb^  Grade    Score  Point  2 


Write  down  why  you  think  each  of  the  two  seeds  BraoNGS 
IN  Group  Ij  2,  or  3. 

Seed  X  WkWj^   fy^    qfOUp  "2,  begflose  ^  oej 


Seed  Y    LADy^C^<:   in  grtPOP   I   <To/>y?J<;g  'fia/^ 

Eleventh  Grade    Score  Point  ^ 

Write  down  why  you  think  each  of  the  two  seeds  belongs 
IN  Group  \,  1,  or  3. 

Seed  X  6gt/>A/<g./A/J?  ASiiAtiS?::  T^^y  ^p^V:,  n  L<i^ 
Seed  Y  fe/LOAf^  /A/    ^  i^gsg/VL/.^^  -fMfr  ^g&^<; 

Eleventh  Grade    Score  Point  6 
5)    Write  down  why  you  think  each  of  the  t'.;o  seeds  belongs  — ^» 

IN   PROUP  Ij  1,   OR  3.  V  <a^) 

Seed  X  0^       ^  g^,^  >ucm/.^ 

/?^^   ix^,    i^fc^  k>-^^JSlJk  -ickc... 
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H 


Third  'hrade    Score  Point  .1 


Now  LOOK  AT  THE  SEED  LABELLED  X-     WhICH  GR-  /OULD  YOU 

PUT    IT   IN?     WRITE  DOWN  WHY  YOU  THINK  SE-E:  .ONGS  IN 

THE   GROUP  YOU  HAVE  CHOSEN* 


Now  LOOK  AT  THE  SEED  LABELLED  X-      WhICH  GROUP  WOULD  YOU 

PUT  IT  IN?    Write  down  why  you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN. 

grog  p. 1    I?)  (-,r.q(,.cp  :4-U^r  s/n^.l/ 


Now  LOOK  AT  THE  SEED  LABELLED  X-     WhICH  GROUP  WOULD  YOU 

PUT  IT  IN?    Write  down  why  you  think  seed  X  belongs  in 

THE  GROUP  YOU  HAVE  CHOSEN. 
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Comments  on  Seeds(c1assify )  Grades  3,  7,  and  11 

The  kind  of  thinking  called  for  in  this  exercise  is  the  same  for  all 
three  grades,  but  the  task  for  grade  3  was  simplified  by  using  only  two  groups 
of  seeds  and  one  unknown  to  be  classified  into  one  of  them  instead  of  the 
three  groups  of  seeds  and  two  unknowns  used  at  grades  7  and  11.    The  task 
required  the  students  to  observe  the  similarities  and  differences  among  the 
seeds,  identify  the  common  characteristics  within  groups  and  the  differences 
across  groups,  and  then  select  the  most  plausible  group  for  each  of  the 
unknowns. 

At  grade  3,  students  had  trouble  identifying  ways  in  which  the  seeds  in  a 
group  were  alike.    Although  no  one  omitted  the  question,  38  pe'^cent  did  not 
provide  any  plausible  common  characteristic.    One-third  provided  two  ways  the 
seeds  were  alike,  but  only  1  student  gave  three  ways. 

For  grades  7  and  11,  to  achieve  the  maximun  possible  score  of  10  a 
student  would  have  to  provide,  for  e:ch  of  three  groups,  three  ways  in  which 
the  seeds  in  that  group  were  alike.    Although  no  one  attained  the  maximum 
score,  3  percent  at  each  grade  attained  a  score  of  9.    More  than  half  the 
grade  7  students  and  a  little  less  than  half  the  grade  11  students  provided  at 
least  one  plausible  characteristic  per  group,  although  about  one-fifth  of  the 
seventh-grade  students  and  one-quarter  of  the  eleventh-grade  students  did  not 
provide  any  plausible  common  characteristic. 

More  than  90  percent  of  the  students  at  both  grades  classified  seeds  X 
and  Y  into  acceptable  groups,  but  almost  two-fifths  at  each  grade  did  this 
without  providing  any  plausible  reasons. 
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In  conclusion,  the  classification  of  seeds  exercise  is  appropriate  for 
grades  3,  7,  and  11.    No  student  at  any  grade  omitted  it,  although  few  did 
very  well.    It  may  be  desirable  to  rafine  the  scoring  guide  to  score  the 
responses  for  each  group  and  for  the  two  unknowns  separately. 

This  task  can  be  used  in  a  future  ^sses^ment  without  change. 
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GRADE  7 


STATION  3 


What  is  the  same  about  the  seeds  in  each  group? 


Here's  what  you  do: 

1)  Look  at  the  collection  of  labelled  containers  of  seeds. 

2)  Put  the  seeds  into  three  groups.    Make  sure  that  there 
IS  something  the  same  about  all  the  seeds  in  each  group. 

You  MUST  USE  ALL  THF  SEEDS. 

What  d',d  you  find: 

3)  Write  the  letters  of  the  seeds  in  your  three  groups. 

Group  A:   

Group  B:   

Group  C:   

4)  What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:   


Group  B: 


Group  C: 
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Activity  Identification:    Seeds  (sorting) 


Grade(s):  7,11 

Method  of  Administration:    Sol ^-Administered  Scat  ion  Activity 
Content  Area:  Science-Biology 

Apparatus  required:    Containers  filled  with  samples  of  labelled  but  unnamed 
seeds:  A  =  caraway  seeds,  B  =  cumin  seeds,  C  =  black  peppercorns,  D  =  millet 
seeds,  E  =  fennel  seeds,  F  =  all  spice,  G  =  white  peppercorns,  H  =  yellow 
mustard  seeds,  J  =  fenugreek  seeds. 

Administration:    Seeds  should  be  placed  randomly  (not  in  groups)  in  front  of 
the  student  before  the  onset  of  each  administration.    Seeds  should  be  replaced 
when  the  level  in  the  container  appears  low.    The  letters  of  each  of  the 
groups  should  face  the  student. 

Servicing:    None  required 


Seeds  (sorting) 
Station  B 

Grade  7  -  station  3 


Scoring  of  the  Written  Responses 

3)  Score  3  pts.  If  the  student  forms  the  following  three  groups: 
Group  1:  A,  B,  E        Group  2:  C,F,G         Group  3:  D,H,J 

Score  2  pts.  if  the  student  forms  any  other  plausible  groups  such  as 
grouping  by  color. 

Score  1  pt.  if  the  student  forms  Incorrect  or  Incomplete  groups. 
Score  0  if  the  student  makes  no  response. 

4)  Score  1  pt.  starting  with  code  pt.  2  for  each  accurate  or  plausible 
statement  concerning  how  the  seeds  In  each  group  are  alike  to  a 
maximum  of  2  pts.  per  group.     Score  1  pt.  if  the  student  provides 
irrelevant  statements  for  each  of  the  groups.     Score  0  if  the  student 
makes  no  response. 


Skills  Involved 

In  this  exercise  the  student  r:eeds  to  classify  a  set  of  stimuli  int. 
groups  based  on  their  commonalities  and  differences  in  attributes.  This 
classification  should  be  based  on  comparisons  and  contrasts  among  these 
attributes. 
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Seventh  Grade   Score  Point  3 

5)    Write  the  letters  of  the  seeds  in  your  three  groups. 
Group  A: 


Group  B 
Group  C 


C.fG 


3)    Write  the  letters  of  the  seeds  in  your  three  groups- 
Group  A:        O/  T  H-  


Group  B 
Group  C 


3)    Write  the  letters  of  the  seeds  in  your  three  groups. 


Group  A 
Group  B 
Group  C 
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.Seventh  Grade    Score  Point  7 
4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS?  j 

Group  A;  .  BanCL^La  -I  {  K    skr7^<^    AKj'rhh    )^\p^  t/cp^S 


4)    Khat  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 


Group  A:  -Lq/\^ 


Group  B:  /;  'H~^'<fG]/)^<:;yi^  jjuij  ci/cd^y  ca^  OJ^f^'  ^  ^ctch^ 
Group  C:      \?  >>^r^-:>^^(k  fo  ^ 


i\)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:   dJnflj>a^Q,  Wc  Onf^^  ^js^jl.  -  dfrvyji^^ 


Group  C:  Jd^x^  y\X-  Qjgj  4Ao  /y>/ywQ  A'Ui^.^  ^tw^M^ 
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Seventh  Grade    Score  Point  2 

3)    Write  the  letters  of  the  seeds  in  your  three  groups.!^ 

Group  A:   C        C-^  (i  

Group  Bi 


Group  C 


3)    Write  the  letters  of  the  seeds  in  your  three  groups. 
Group  A:    ^  ^ 
Group  B 
Group  C 


3)    Write  the  letters  of  the  seeds  in  your  three  groups. 
Group  A:    \)    hf  J"  


Group  B 
Group  C 
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ERIC 


Seventh  Grade   Score  Point  6 


^i)    What  is  the  same  about  the  seeds  in  each  of  youk  iMKtt 

GROUPS? 

Group  A:      Srv\oJll   ,    rc^i^^nck.  S:>jej?yC^  >  


Group  B:   U^tv^c      kov^ncj  jrJ^  .  

Group  C:    <^0<\  ufy    LLL^  ^ .   


4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:   Qi(L  ^J)Ajl.  <!U\X..  UnlH  y^eJlyU^  ^\i.<i  Jl^^l 


Group  B:   QSik.  Q,,    AStJ^  /^^\ 

Group  C:     ll^fi^  ^fkk.^A    n^.  oJXL  v^ru^  ..a^v<A 


^)    What  is  the  same  about  the  seeds  in  each  of  your  three 
groups? 

Group  A:  $€<^  CO\)  v\ck  CX^/^(3i 

Sl3  

Group  B:    aW    S^^5  \  OV\CK     (X^^c\  ■ 


Group 
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.Seventh  Grade  Score  Point  5 

)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS?  ! 

Group  A:   /U^oL   OJ^      Acrrrin^  ^jJ 


Group  B: 


)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:  Spcry-^    N   Or-c^t^n  (V  V^c^g. 

Group  B:  (W^  se<^d^    \^  youp  (?>      Rr-f  rour^rSi  , 

 ;  (fs 

Group  C:   r\\\    4^,  Sg-PdS    \r\     a|Oup    C  dr^ 

What  is  the  same  about  the  seeds  in  each  of  your  three 
groups? 

Group  A:               ^^jj  .^^ut^  (X_  X-^y  xoX^ 

Group  B:    C  /z^^ccrcy 
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Sevemth  Grade    Score  Point  4 
What  is  the  same  about  the  seeds  in  each  of  your  ihkee 

GROUPS?  i 

Group  A:  SVm?\/   a\V  9^V^0^v^pi)A   Ov\\V^-P  ^  ^rv^K 
Group  B;    a \V    ac^     y^fV  <g^fY\Qj \  i  V^a\/J^ -Vrv^ 
Group  C:    qA\  Wvn^  e:>P4?A'^  -V^^a.^^^ 


What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:  77 >l  o  MOd/))  an.0  Jlaf  dmcL 

Group  B:  "T  H  C  y:^0OC/■/0  nni   nOO  r\  ^;fn  ( -f  ^KQ■ 

Group  C:  ClAJ        .-fKc/vrN  Ano  4l^^iJ1  


What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 


Group  A:  ''^^^^e>>^    rvCe^  \ 


Group  B:  T\;^'^H  QkW     V^ve     Ok,  <^r) 

Group  C:    ^"hg  tA     OjCf,    ^ftsV\>j  OoUi\^ 

9nQ 


9c^V  H 

S'BmYH  (iRADE     ScORE  PoiNT  3 
4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS?         ,  .  . 

Group  A:    m^'/W-     (ytrT  rK 
Group  B;     nVwA  -'aSL       Cy^..^        ^  ^Msi: 
Group  C:     ■  /f  JLc'nJg 


4)    What  is  the  same  about  the  seeds  in  each  of  your  three 
groups? 

Group  A:   IV^o.j     crfb    r>\\  ^^r\\  

Group  B:   d!  K>^.^.    4W    <r.i^  ^Vvpi  


Group  C:   c&  War,    a  aVoa-t 


4)    What  is  the  same  about  the  seeds  in  each  of  your  three 
groups? 

Group  A:  ThPj.  S»Vy-\  •lir^ib 

Group  B:  UiPII   .^V^,   <?>^nrV    ^^Vj  ^"2^ 

Group  C: 
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Seventh  ^prade    Score  Point  2 


tnolpl?  ^^^^  ^^^^^    '^^  EACH  OF  YOUR  THREE 


Group  A:   ^Vl^mibnflQ  i:Vbap^A  ^^^C^Wi\  fYY\ y i /rVi^,^ 

Group  B:  ^Wr>Q46.  nrno  a OUvA^n^^nje ^3^^^ fiv^  ' 

lifiii^  qvmSI  oj^^-^  S^Omij 

GROUPS?  ^^^^  '^^""^  ^'^^^  '^^^^^ 

Group  A:    ^  gjs     cj(  fi^  ^.^^ 

Group  B:   J/    -.h^^.      i/n  oX/. 


Group  C:  ^  J  ^  ^ 


sSSIpi?  ''^^^  '^^"'^^  ^^""^   OF  YOUR  THREE 

Group  A:  '^^^    ^rcr,  rrK..^r^   


Group  B:  ^y-g   Q//  of 


Group  C:      ^Q-^  -fAr 
c:)hftrv?  
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Seventh  Grade    Score  Point  1 


Write  the  letters  of  the  seeds  in  your  three  groups. 
Group  A; 


Group  B 
Group  C 


DBF 


Write  the  letters  of  the  seeds  in  your  three  groups. 
Group  Ai 


Group  B 
Group  C 


Write  the  letters  of  the  seeds  in  your  three  groups 
Group  A:  p\  C!  


Group  B 
Group  C 


£  B  i 

B  
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Setemth  Grade    Score  Point  1 
4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:   "tKox/    anf     nj>  ^  j!^^jn^s?r4 

Mil  r>ajvrv<9   

Group  B:  tlrUU^  C\  ^  <l  A  (Lg  A^(rfy^^  ^T^^ 
Group  C:  i-V\QA^.    aA  g     Cl^%  (no  r^(l^\ 

4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:    Tl\.ei/  "Snnell  ■  ^p'l  cgvy'  -  -•  . 


Group  B:    <^<^f>^  pier.5inr.  *^,^.n 


Group  C:    Tg,y  Uoue  m  <>rr\^\j 


4)    What  is  the  same  about  the  seeds  in  each  of  your  three 

GROUPS? 

Group  A:    TAe.  ^^ej^  /h   ihCljp  k  ahd  ^  Uo>K  ^ 
Ufity  >^,f_cl^  qh/k^  p\(ce^tdA^i^/;^^7^^^ 
Group  B:     ^^^^f  i/^  iy  <^  ftu/ai>  H^^^  k  Ca/> 

Group  C:     (^Ufi  &  qa^  H  C^re,  hn  tk     ^ff^r^e,  <:iQ/>^ 
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Comments  on  Sggds(sort )  Grade  7 

In  this  exercise,  seventh-grade  students  Were  asked  to  sort  a  collection 
of  seeds  into  three  groups  and  then  describe  the  similarities  among  the  seeds 
in  each  of  their  groups.    This  required  close  observaton  of  the 
characteristics  of  the  seeds  to  identify  their  simnarlties  and  differences  in 
order  to  form  the  groups.    Every  student  divided  the  seeds  Into  three  groups, 
and  84  percent  formed  the  groups  with  the-  more  important  common 
characteristics.    Only  ten  percent  did  not  cite  any  plausible  way  in  which  the 
seeds  in  any  group  were  alike,  and  2l  Percent  provided  two  plausible 
statements  for  each  group. 

This  exercise  can  be  used  In  a  future  assessment  without  change. 
However,  it  may  be  desirable  to  refine  the  scoring  guide  to  distingu 
between  those  students  who  provided  on^  similar  characteristic  for  each  group 
and  those  who  provided  two  or  more  characteristics  for  one  group  and  none  for 
another. 
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GRADE  n 


STATION  3 


What  is  the  same  about  the  bones  in  each  group? 


Here's  what  you  do; 

1)  Look  at  the  collection  of  labelled  bones.    These  bones 
are  from  the  backbones  of  different  animals- 

2)  Put  the  bones  into  three  groups.    Make  sure  that  there 
is  something  the  same  about  all  the  bones  in  each  group. 

You  MUST  USE  ALL   THE  BONES. 

What  did  you  findi 

3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:  

Group  B:  

Group  C:  

4)  What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:   


Group  B: 


Group  C: 
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Activity  Identification:    Vertebrae  (grouping) 


Grade(s):  7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Sci ence-Bi ol ogy 

Apparatus  required:    Eleven  bones  labelled  A-L  as  follows: 

A  =  Lumbar  dcg 
R  =  Cervical  rabbit 
C  =  Thoracic  dog 
D  =  Thoracic  cat 
E  =  Lumbar  dog 
F  =  Atlas  dog 
G  =  Cervical  rabbit 
H  =  Cervical  dog 
J  =  Lumbar  rabbit 
K  =  Thoracic  rabbit 
L  =  Lumbar  rabbit 

Administration:  Bones  should  be  randomly  placed  (not  in  groups)  with  the 
labels  facing  the  students  before  the  onset  of  each  administration. 


Servici ng:  Minor  gluing  if  necessary 


.  1 

f'            .  .•  .      *  * 

■ .  -  ,/•■"• 

■  m 

W  -  ■' 

Vertebrae  (Grouping) 
Station  B 

Grade  il  -  station  3 


Scoring  f/f  the  Written  Responses 

3)  Score  A  pts.  If  the  student  fomiK  the  following  3  groups: 

A         E         J         L  (lumbar) 
B         F         G         H  (cervical) 
C         D         K  (thoracic) 

Score  3  pts.  If  the  student  forms  the  correct  groups  except  for  the 
atlas. 

Score  2  pts.  If  the  student  forms  one  correct  group. 

Score  1  pt.  If  the  student  forms  any  three  groups  different  from 
those  specified  above. 

Score  0  If  the  student  makes  no  response. 

4)  Score  1  pt.  each  starting  with  code  pt*  2  for  an  accurate  or 
plausible  statement  concerning  how  the  bones  In  each  group  are  alike. 
Score  to  a  maximum  of  the  two  best  responses  for  each  of  the  three 
groups  of  V^nes.     Score  1  pt.  If  the  student  provides  aa  Inaccurate 
or  Irrelevant  set  of  responses  only.     Score  0  If  the  student  makes  no 
response. 

Skills  Involved 

In  this  exercise  the  student  needs  to  classify  a  set  of  unfamiliar 
materials  Into  groups  based  on  their  commonalities  and  differences  In 
attributes.    This  classification  should  be  based  on  comparisons  and  contrasts 
among  these  attributes. 


EKLC 
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Eleventh  Grade   Score  Point  4 


3)  Write  the  letters  of  the  bones  ^in  your  three  groups. 
T    Group  A:       C    T)  .  ^  

'! — ^  ^  

Group  B 
^     Group  C 


3)  Write  the  letters  of  the  bones  in  your  three  groups 


c 


Group  A 
Group  B 
Group  C 


c 


3)  Write  the  letters  ^f  the  bones  in  your  three  groups 
Group  A: 


Group  B 
Group  C 


ERIC 
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Eleventh  Gp7\de   Score  Point  3 

3)  Write  the  letters  of  the  bones  in  your  three  groups. 

^    Group  A:       A  g.F  .J  L  • 

C      Group  B:      6.  C-M  

T     Group  C:  D,  K  


3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:   0  ^  T  ^       ^  F  

Group  B:         ii^B  .  [p  

I — Group  C:  ^  L  <"  


3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:       1/  ,C^F  

^  Group  B:  A'^U.^,  

Group  C:  ^  A-^-  
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Eleventh  Grade    Score  ?oim  2 

3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:      B ,  G  

Group  B:     C  ^  K.  

Group  C:     A  ,       f  ,  H,  T.  L  

3)  Write  the  letters  of  the  bones  in  your  three  groups- 
^  Group  A:     C- :^\) ^   

Group  B:     fV  .  ^  >  t4   J*  j.   

Group  C:   


5)  Write  the  letters  of  the  bones  in  your  three  groups. 

6R0UP  A:   J]/   

GROUP  B:       /]./^^£.  f^fr^  H  

7"  GROUP  C:   C.^T)J..  
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Eleventh  Grade    Score  Point  1 


3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:    A,  E^CL'^  ^  -  ^  Q  

Group  B:  Or?  

Group  C:     \C ^  T.  Z~  

3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:  ^  

Group  B:    H  ^  1 ,  3  

Group  Cj    ?3,  <^.0.0,  tC  

9          3)  Write  the  letters  of  the  bones  in  your  three  groups. 

Group  A:   g  j  l  

Group  B:  Q^rh.v^^  

Group  C:        .  ft  


• 
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Eleventh  Grade    Score  Point  6 
What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:  aii  VxfliVf.  Qi^  forig  piieCj?   prnjfch'inn  •  a_C^ 

Group  B:    oJli  k(XJ\K    a   CQJ^-hul     |n^vrjf>  nVlgn  iMiff^ 

/^Q/^   gy^d  fi/JQ  }nior\  piecj?^  pm^  pr-h Vi  g  eui 
Group  C:  Oij^  aX^.  ^<.qenh'a l/tj   ^  CJUitral  6-lTi(r-fiyio^ 
^      (A)i'1^'' /^Q|g       ili^  middle.  aY\A  no  hw^  >{ol^o 
pedis  projec-hVi^  of^-  Hviii^ 

gSSIps?  ^"^^  ^^""^  YOUR  THREE 

A:  ^  ^nn^4^  »    ^^^^  .tJb::dU^ 


What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group/ l[:     Okq.  JyjJLi.    fi^X.    w-^^  '^^^^   

GrouP^.         yj^D^       -Lrl^      KoA  -kLju) 
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Eleventh  6rade    Score  Point  5  ^ 
What  is  the  same  about  the  bones  in  each  of  your  three 

oROUPS.  I  I 


Group  C:   mt   -fO../>   /mtk^  .1^.^    4^..^  i).Hb^J 


4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group^:    "'^QgO  '^^-^^    'f-'^^^-^",-^n^T  fTn^ 

Group  B:    rrhP  jg^^y?.  -C^t^fl^  b/^V  r-^n  <v  0 

Group  Cj^-   rdO  r^A^azLcA  >  l/feo     o\j^Ofl>  i^Ltyc^ 

4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:  yoo  V\q/<^ -Hnem     O^r-^'^.  ^"^i  ^         I arjc  ^mvoc^'r^  t^qc 

Group  B:  y^u       ^>r7>ir^k  Wv.  Kr^ig           <r:tHi.  S  por-f^^.<s(o^■^  \ 

Group  C:  X-f-ytK)  (eofe^-jihffHjqk  -IhC  KoU-Mm^  OJU  hOJXQ^ 

 S)C(i.^ 
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ELEVEtmi  I3RADE   Score  ?om  ^ 
4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group^   TUzi.  bone;  hg^  ^^^^^  c^oi(   p^^W.aic  bj-f 

Stands  Ta^-V.  

Group^  Zrt^c  booijs         4vh^  no4<;4rj^^-./iA  pr:;KK)o^^? 

W  ^   

^)    What  is  the  same  about  the  bones  in  each  of  your  three 
groups? 

Group J:    Xhty  A<xVfc      fh£  -h/p/> 


 ^  »nr  '   n*-^ — cinw    I  -v  a.  -  ■  -v- 

o  TV  /wq  smaH 


Group  C: 


^)    What  is  the  same  about  the  bones  in  each  of  your  three 
groups? 

GROUPyA 
Group  B: 

Group  C:  ^^f  )f\dW  a   majjf\  t>OAsh  m iUmk  h^k. 

hmjfs  shcLxM^  m^^.  Met  mjL  Mqr^  .Itrxij 

ERIC  ^^'^ 


Eleventh  C-rade    Score  Pqint  3 
4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:  ^^hf  aw  V\0^\t&  PrOnnTKl^rH   ^lO^y^D/jP.  grriwfh^^ 

n^6]jed  fn  ^  pntMii  bong  


Group  B:   fH-^J^  Oil  V)6.w  Am  fi)  hnr^.  fWn  pre.ce 


s 


6(  to/\e  <mf  shci^  0U'\' 


Group  C: 

\^o)f\t  ihaf  sfccic^  c^of;  H^  ^hc<^  c^'Jc 


^)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:  "HftS    BoAJS^    IM  TNIS  G^OUf 
Group  ■Bi'V^^SP^    V3g>><?  /^-(/^V^     euJ€     \  hx^iC.  P^^-e 
Group  Ci^Tj^ff^C    Qv-a^^S     ^(^^hL  /.)7)    '^iSTlN  CTW/f- 


4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group^A:  %\cW\pcA  4vi|^. hr,lin<i) ^be ii be.  t^xitrs .  ^rml\fr 


Group  B:  ""hk^mfUVf.^^ri^ .  vm^r^i^  sftLneA  |>rff^ri:>4'i cn'^  f /C  , 

ferP-  (3/. 

Group  C:  $Q)ftl£VMl*ir.  (Np^hVgi? ^\n6|y  Ur^pn4^n>^fn^  jn^rj- 

Er|c  <^'if^os^l)«f]P«^'^ouJca"Hlo-fr^  224^ 


Eleventh  Grade    Score  Point  2 
4)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 

Group  A:      T^fx'  ^^-^   /y^/>>r^.^^  gr.,./ ^^^^ 

7^     /ji'-rf^    j/ttr/r  i^c>^yi',  

Group  B:  .  77^-^  -i.-  C  >0iJ>   m.-J^,  .  77/..>  >C">.-^  g . v  o^j--  ^^^^ 

Group  C:      t^^x    /s,^    /J*  >/^7^  i-./^-^ 

^/  /   /  ' 


GROUPS^  ^'^"^  ^'^^^    °^   ^^^^  ^^^^^ 

Group  A:  iV^  ^  r  ^V.^     T't^      [  k 

Group  B:  ^[{  UWU.o^s  l,..^4-Uw.U    u..^     u  .<  /.n.^       L  .  © 

Group  X:  ^       I  |i  U^-)./^^,    t,.^,    J^^'-^:^? 

1/ 


GROUPS?  ^'^^^  '^^""^  ^'^^^   °^   "^"""^  '•'"''^^ 

Group  A:    \    S  (       p  ,  rptft/ j    u  V4;  ^   ^r, ^  ^  F  <^7i^-V^ 

GRoup  B:  ^Vy^Arj^f^o^/^^.V.-v^  /C,r^ 

Group  C:                   OaW            rbbOydK^^  ^^^ddllL" 
I^Vf^?  


o  225 
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Eleventh  Grade    Score  Poirvrr  1 
U)    What  is  the  same  about  the  bones  in  each  of  your  three 

GROUPS? 


Group   


Group  B:  ""7,  >\x>^^   r\  n  o   >'^y-rv^  j)0  ^  f  h^'ifc)^ 

Group  C;    rS-^vQ  ->Y\i  vQ  ^^^"j^.  o /t?) /) r^f 
,_pr>  ^4^'^^■^  S:?Tr\x>  .>y1j  u:)    ^  .  ,/>>r>yx>j, 

grSIps'  ^^"L''''^'  about  the  bones  in  each  of  your  three 

GROUPS!'  f\it\n^.         ^o..   t^'-     i     3,^^^,  ^(^„,f_^ 

Group  C:    (.vqu^    T  (oA.w  fu  IL      L..,,         p  ^ 


4)    What  is  the  same  about. the  bones  in  each  of  your  three 

GROUPS?  ^ 

Group  A:   tb  >\f\t.^^  ^  n^<3  ^Qp^  bvj^^^€  ^i^^C:') 
Group  B:  aOufve. baff C              4f)eXj qJ  I  /nn/-4hp 
Group  C:  -gpime.  €)Wapf.  ri^^.^y^->r   


ERIC  226 


Comments  on  Vertebrae( sort )  Grade  11 

In  this  exercise  which  called  for  students  to  form  groups  of  vertebrae, 
the  students  had  to  observe  the  bones'  similarities  and  differences  and  report 
their  sorting  results.    Plausible  groups  of  vertebrae  could  be  formed  by 
matching  the  bones  on  external  morphological  characteristics,  such  as  number 
of  projections,  size  of  projections,  number  of  foramen,  size  of  centrum,  or 
general  shape.    The  best  grouping  would  contain  thoracic,  cervical,  and  lumbar 
vertebrae  in  their  respective  groups.    The  Atlas  is  a  slightly  atypical 
cervical  vertebrae,  therefore,  it  was  anticipated  that  some  students  would 
find  it  a  problem. 

For  the  third  part  of  this  o.^ercise,  54  percent  of  the  students  were  able 
to  correctly  place  the  thoracic,  cervical,  and  lumbar  vertebrae  in  their 
respective  groups.    Another  20  percent  of  the  students  correctly  grouped  all 
the  vertebrae,  but  misplaced  the  Atlas.    A  valid  statement  distinguishing  at 
least  one  feature  of  each  group  o^  the  vertebrae  was  made  by  67  percent  of  the 
students  for  part  four  of  the  exercise. 

Based  on  these  results,  it  was  the  consensus  of  the  advisory  panel  that 
this  exercise  is  suitable  for  eleventh  graders  and  also  would  be  suitable  for 
seventh  graders.    Also,  the  administrators  reported  that  the  students  appeared 
to  like  the  challenge  of  sorting  the  vertebrae.    The  materials  for  this 
exercise  are  fragile,  but  small  and  very  easy  to  set  up.    With  sufficient  lead 
time,  the  bones  are  easy  to  obtain.    This  exercise  is  appropriate  for  any 
future  national  assessment  at  eleventh  grade  and  probably  at  seventh  grade. 
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GRADES  3,7,11 


STATION  2 

I 

I 

How  DID  THE  AMOUNT  OF  SAND  IN  THE  TUBES  AFFECT  THE  TIME  IT  | 
TOOK   FOR   THEM   TO   ROLL   DOWN   THF    SLOPE?  1 


Here's  what  you  do; 

1)  Roll  tubes  and  C  down  the  slope  one  at  a  time. 
What  did  you  find: 

Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH   OF   the   tubes   AFFECTED   HOW   FAST    IT   ROLLED   DOWN   THE  SLOPE* 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes- 

2)  Tube  A   

3)  Tube  B  

4)  Tube  C   

Now   ROLL   TUBE   D   DOWN   THE  SLOPE. 

5)  How   DID  TUBE   D   ROLL   DOWN   THE   SLOPE   COMPARED   TO  THE 
OTHERS? 


Explain  what  you  found; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes- 


228 


Activity  Identification:    Sand  and  Tubes 


Grade(s):  3,7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:  Science-Physics 

Apparatus  required:    Three  identical  capped  plastic  test  tubes  labelled  A,  B, 
and  C,  each  filled  with  sand  to  different  levels;  one  empty  capped  plastic 
test  tube  labelled  D;  wooden  or  plastic  incline  with  START  clearly  printed  on 
the  top  of  the  incline;  paper  and  pencils. 

Administration:    Tubes  should  be  placed  in  a  suitable  location  where  they 
can't  roll  into  one  another.    Tube  0  should  be  placed  close  by  but  physically 
distinct  from  ti     other  three  tubes.    The  incline  may  be  placed  on  the  floor. 

Servicing:    Tubes  should  be  stood  up  after  every  administration  to  level  off 
the  sand. 


Sand  &  Tubes 
Station  A 

Grade  3  -  station  2 
7  -  station  2 
11  -  station  2 

Scoring  of  the  Written  Responses 

2-4)    Score  4  pts.  for  a  statement  or  set  of  statements  which  accurately 
assess  the  relationship  between  the  speed  down  the  slope  and  the 
amount  of  sand  In  the  tube  (l,e,,  the  more  sand  In  the  tube,  the 
faster  it  rolls). 

Score  3  pts,  for  statements  which  only  note  how  the  tube  rolled  down 
the  slope  (e.g.,  the  tube  rolled  fast)  or  how  much  sand  was  In  the 
tubes  (e.g.,  the  tube  had  a  little  sand  In  It). 

Score  2  pts.  for  an  Inaccurate  statement  about  the  relationship 
between  the  speed  down  the  slope  and  the  amount  of  sand  In  the  tube. 

Score  1  pt.  for  an  Irrelevant  or  Incorrect  statement  or  set  of 
statements. 

Score  0  If  the  student  makes  no  response. 

5)  Score  2  pts.  for  an  accurate  statement  or  set  of  statements  about  how 
tube  D  rolled  down  the  slope  compared  to  the  other  tube^-.     Score  1 
pt.  for  an  irrelevant  or  Incorrect  statement  about  how  tube  D  rolled 
down  the  slope.     Score  0  if  the  student  makes  no  response. 

6)  Score  3  pts.  if  the  student  notes  two  or  more  of  the  following:  1) 
that  sand  slowed  down  the  partly  filled  tubes,    2)  that  sand  could 
not  roll  around  In  the  full  tube  and  therefore  makes  the  tube  roll 
faster,  or  3)  absence  of  sand  made  the  tubes  roll  faster. 

Score  2  pts.  If  the  student  notes  one  of  the  above.     Score  1  pt.  If 
the  student's  response  Is  Irrelevant  or  doesn't  provide  an 
explanation. 

Score  0  If  the  student  makes  no  response. 
Skills  Involved 

In  this  exercise  the  student  Is  to  formulate  a  hypothesis  or  set  of 
hypotheses  to  account  for  her  or  his  observations.     In  order  to  formulate  this 
hypothesis  the  student  must  make  comparisons  and  contrasts  between  specific 
observations  (i.e.  the  different  tubes). 
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Third  Grape    Score  Point  ^\ 


cAru  he  "^"^  SPACES  BELOW  HOW  THE  AMOUNT  OF  SAND  IN 

EACH  OF  THE  TUBES  AFFECTED  HOW  FAST   !T   ROLLED  DOWN  THE  SLOPE 

Tell  how  fast  each  tube  rolled  compared  to  theTher  tuI^ 
2)    TubeA  A    ^h<  U.W 

Tube  B  LU   B  ■hr<r+~  .L     L.       ' -^f 

Tube  ClSc  C — ^ — <.L^/Qs'f 


1) 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled ^compajRed 


0  THE  OTHER  TUBES* 


2)  TubeA_J]MZ 


3)  Tube  B  ,ni>^^jC(. ^^JOX^^^^ 

4)  Tube  C  A^miMtj/^A  .HMy  .MJMLa^. 
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Seventh  Grade    Score  ?oim  ^  VojjAs 


Write  down  in  the  spaces  below  how  the  amount  op  <?AMn  tm 

EACH  OF   THE   TUBES   AFFECTED  HOW  FAST   I  rROLLEHowJ  ?Sp  J,  npJ 

Tell  how  fast  each  tube  rolled  compared  to  tSeTSeJ  tubes 


."o,    cM^n    ,uBt   KULLtD  COMPARED  TO  THE   OTHER   TUBES-  I  


Now 


EACH   OF'^HP°?uLi\«LxcJ^''  OF   SAND  IN 

EACH  OF   THE   TUBES   AFFECTED  HOW  f  ,ST   IT   ROLLED  DOWN   THE  SLOPE. 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tuIes^ 


4) 


Tube  C  jfyJ>oA   r^huir /^^^ 


Now  ROLL   TUBE   D  DOWN  tIJe^SLC^F. 


9 


P4r»  nc  ^'^'^^^^  AMOUNT  OF   SAND   IN  /  . 

EACH  OF   THE   TUBES   AFFECTED  HOW  FAST   IT  ROLLED  DOWN   THE   SLOPE.  fl( 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes.  I 
2)    Tube  A  Th.bp    ft  ojq^         -^^.^W  4i^«  ri'rl^il  r^^^  ^- 

Tube  B  \o^^C  -\Vaf>  ^.^Vy.  r  M  .fnu^r  Un.,  A^^^^^^K'^X^:^ 
Tube  C^ow^   Wu.<>g,  '4V^^  ^'^^  |^/.r^.^^,  ^Wi^^  VUi? 
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ELEVEhTTH  Grade   Score  ?oim  ^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in> 
eAqh  of  the  tubes  affected  how  fast  it  rolled  down  the  "slope. ( 

fgl^L  How  FAST  each  TUBE  ROLLED  COMPARfD  TO  THE  OTHER  TUBES-  --t— - 

;  •  %ce^.- 


2)  Tube  A  IJ^  kkIM 

3)  Tube  B  ^Iv)  kk^ 


^)    Tube  C^\y)  IaO/)  ilfclv^  jj^^  . 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

tAcH   OF  THE  tubes  AFFECTED  HOW  FAST  IT   ROLLED  DOWN  THE  SLOPE. 
I^LU   HOW  FAST  EACH  TUBE   ROLLED  COMPARED  TO  THE  OTHER  TUBES- 

2)  TUBE  A       m^g  sxrxjf-  m&z  acczkca^heh 

3)  TUBE  B       less  ?ariq-  siQj^r  aoc^/e^g to 
^)  TUBE  c       -5hl^   >^s^  Aand-  j>/c(A^r  ac&iJmf],^^ 

NOw  ROLL  TUBS  D  DOWN  THE  SLOPE- 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
EacH  of  the  tubes  affected  how  fast  it  rolled  down  the  slope- 
T^lU  how  fast  each  tube  rolled  compared  TO  the  other  tubes 


2)    Tube  A 


:h  tube  rolled  compared  to  the  other  tubes^,^^ 


3)    Tube  B 

10    Tube  C  jhcin   -hh^ /^hl^  <s) Ut^^ pOJUl^ 
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Third  GrAde    vScore  Point  3 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  of  the  tubes   AFFECTED  HOW  FAST    IT   ROLLED   DOWN   THE  SLOPE. 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 


2)  Tube  A  _ 

3)  Tube  B  _ 

t\)    Tube  C   ^^.j/m^rCd- 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 


2)  Tube  A 

3)  Tube  B 
^)    TuEt  C 


3)    Tube  B      it^  i^ttl^rCe^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast.  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 

2)  Tube  A  B>.<-/-^.r     \\r.^^       fW-f.  ofli<?/'S 

3)  Tube  B  C^^   /.  \\\^.     c\<s>.jp^    \\'\^.vy  r, , 


Tube  C  (L  1^4-'  s. 
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Seventh  Prade   Score  Point  3 


^.r^^  ^"^"""^  """"^  SPACES  BELOW  HOW  THE  AMOUNT '  OF   SAND  IN 

tJm    Snw''cL^"'''  AFFECTED  HOW   FAST   IT   ROLLED  DOWN  .?Ee  SLOPe' 
I  ELL  HOW   FAST   EACH  TUBE  ROLLED  COMPARED  TO  THE  OTHER  TUBES- 

2>    Tube  A    C).  .^jslLd  j^^.  ^4^  — 

3)    Tube  B  J  nr^  r.  .  i  Udk    ^^f^.ua  .(^ 

^>    Tube  C     C  ,rr      loH       f\<.y   , 

Ff,c»  ^?^^Er•°?^!Sci^  ^^^^^^  THE  amount'  OF   SAND  IN 

EACH  OF   THE  TUBES  AFFECTED  HOW   FAST   IT  ROLLED  DOWN • THE  SLOPE 

Tell  how  fast  each  tube  rolled^cojipared  to  the  o?heJ  tubes 
2)    Tube  A  lu^^ 


3)    Tube  B  /^^^^ 5y.^/^iy^k^ 


4)    Tube  C      ixjr)Jl  ^Mit^ 


o.ru  "^"^  SPACES  below  how  THE  AMOUNT  OF   SAND  IN 

EACH  OF  THE-  TUBES  AFFECTED  HOW   FAST   IT  ROLLED  DOWN ' THE  SLOPE- 
I  ELL  HOW   FAST  EACH  TUBE  ROLLED  COMPARED  TO  THE  OTHER  TUBES- 

2)    Tube  A  roWed     ^'^Wx-   VWr>  \De;V\^^^ 
5^    Tube  B  ^o\\C<S  ^nuoer    W/>y>>    K  Vmp  V-Cbsier  VVv>^C 
4)    Tube  C  CoWed  <^\oooer  ^    W  Keift^ 


er!c 


ELEVEhTTH  Grade    Score  Point  3 
Write  down  in  the  spaces  below  how  the  amount  of  sand  tm 

EACH  OF   THE   TUBES  AFFECTED  HOW  FAST   IT   ROLLED  DOWN  ?HE   S^SpE   . 

Tell  how  fast  each  tube  rolled  compared  to  theTher  tuIes:  /^^^^ 

2)  Tube  A   />^vc-^  a.^.^  \  LvA^jt^  ti/^  6  (S^  ^ 

3)  Tube  B  .Qsj^  -fJc^  fi^/WNJL  j^^^  \  U^XU^C 
^)    Tube  C             1^^^  \  pS^.Jjf^^  ^  ^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

each  of  the  tubes  affected  how  fast  IT  ROLLED  DOWN  THE  SLOPE- 
lELL  HOW  FAST   EACH  TUBE  ROLLED  COMPARED  TO  THE  OTHER  TUBES- 


2)    Tube  A     fn\{m  fe^ 


3)    Tube  B     {n\if^    Srrnfifj   fgdrq^  V  y' 

^)    Tube  C     fDH-fJ      <^{f>f  iTf<:-| .  


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  V)F  THE  TUBES  AFFECTED  HOW  FAST    IT   ROLLED  DOWN"  THE  SLOPE- 
lELL  how  FAST   EACH  TUBE  ROLLED  COMPARED  TO  THE  OTHER  TUBES- 

2)  Tube  A  \         r7)i)/^^   ^_ 

3)  Tube  B   aUo'^  At  IW    ^   n^HM  r-^^^.dii.:Z 
Tube  C  al^^OS^    A  P,  IkJ  ^    r-7J  \          S.k,^  f 


i 
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Third  Grade   Score  Point  2  V<saj^^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  OF   THE  TUBES  AFFECTED  HOW  FAST    IT   ROLLED  DOWN  THE  SLOPE- 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes-' 

2)  Tube  A  ^Ji9}i^      aaj^     XjU  AlLf^yU^ 

3)  Tube  B  LaW^     Xj^JltJ  VtuJht. 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  OF  THE  TUBES  AFFECTED  HOW  FAST  IT  ROLLED  DOWN  THE  SLOPE- 
TeLL   HOW-FAbT   EACH   TUBE   ROLLED  COMPARED  TO   THE  OTHER  TUBES. 


2)  Tube  A     F^^h   . 

3)  Tube  B    q  fe/'r^     //7v/^ ^   


4)    Tube  C    n^d  ^  llHIp,  y)  /' ^  .C W^K- 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  OF  THE  TUBES  AFFECTED  HOW  FAST  IT  ROLLED  DOWN  THE  SLOPE- 
lELL   HOW  FAST   EACH  TUBE   ROLLED  COMPARED  TO   THE  OTHER  TUBES- 


2)  Tube  A  Cf  ^"t"  

3)  Tube  B      ^    I  0  Vi/--^ 


4)    Tube  C     S    ]  ^    \a/  e  ^ 


2T/ 


Third  Grade    Score  Point  1 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  .fast  it  rolled  down  the  slope* 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 


2)    Tube  A  _A 


3)    Tube  B  Jl 


^)    Tube  C  2. 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope* 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes* 

2)  Tube  A 

3)  Ti.RP  R  -T^AST^  

Tube  C  .  1^' 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  OF   the  tubes  AFFECTED  HOW  FAST   IT  ROLLED  DOWN  THE  SLOPE. 

Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes* 

2)  Tube  A 

3)  Tube  B  \Af  K^n  \\  rdllpJ  Ij  loo\^^(i  I  \  !^^/Vas-/u//; 
i})  Tube  C  \^^on,'4        !  I  <?rl  o^j^ja    <^at\  (L-^A)eKA  rri\ify4^^  q  ^ 
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SEVEriTH  Grade    Score  Pom  1  Vc->.e-\'ri  ^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 

:     2)    Tube  A    ^JP"^  hh^^ 

3)  Tube  B  rJ^/^ ur^^"^ U^f^^ 

4)  Tube  C 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 

2)  Tube  A  AT-^-   VNje>v^^    y.i  ryj  t^T  TgvsV  »  

3)  Tube  B  "X-V    xioe-v^    X^'tk^T   ^\r\r^\r\  A 

4)  Tuerc^V  v.ifi^-V  -fe^AcT  4A^Ay-\  /\^^ 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  HOW  fast  each  tube  rolled  compared  to  the  other  tubes.      C  \\ 

2)  Tube  A   oSf/jMVA  d&U^  ^tJm,   ^^rrfi>        <,  :JuJ'...y*<yud^ 

3)  Tube  B  ^  ^  (Lfi^^rVhlJw.Acspe^y^^ifhi^r.f^^f^ 
^)    Tube  C     sU^UJnJ\    tLo^.K^  'i:ko    (Aftpi?  \  yi^^l  to^^  ,^ 
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Eleventh  Grade    Score  Point  1 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 

EACH  of  the  tubes  AFFECTED  HOW  FAST  IT  ROLLED  DOWN  THE  SLOPE- 
JELL  HOW  FAST   EACH  TUBE   ROLLED  COMPARED  TO  THE  OTHER  TUBES* 


2)  Tube  A 

3)  Tube  B   

^)    Tube  C    -Pcv  S-Af-  sj— . 


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell  how  fast  each  tube  rolled  compared  to  the  other  tubes. 

2)  Tube  A    ^oV\^(\.^^^    »s\ovM^J  h^.^AOA 

3)  Tube  R-^Va/w^  ^Tsar,  .  V\^;l  ^  ^c./\r  

4)  Tube  C  ^C^U^  .  Q  \  6\.  tA^  afU^  


Write  down  in  the  spaces  below  how  the  amount  of  sand  in 
each  of  the  tubes  affected  how  fast  it  rolled  down  the  slope. 
Tell. how  fast  each  tube  rolled  comparel  to  the  other  tubes. 

2)  Tube  A  \^\^\^^  C^^^^Ap^  \^  G&Sj .  - 

3)  Tube  B   S  S'Jnlk^  Ce^^^cjn?.e  

Tube  C   UL\?y^   V^rxae^.  PrCr-\    Co^er^   «^.\q..yjeg  . 
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Third  Grade   Score  Pom  2 


5)     How  DID  TUBE  D  ROLL  DOWN  THE   SLOPE  COMPARED  TO  THE 
OTHERS? 


5)     How  DID  TUBE  D  ROLL  DOWN  THE   SLOPE  COMPARED  TO  THE 
OTHERS? 


5)     How  DID  TUBE  D  ROLL  DOWN  THE  SLOPE  COMPi^RED  TO  THE 
OTHERS?  . 
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4 


SEVEhTTH  Grade    Score  Point  2 


Now  ROLL   TUBE  D  DOWN  THE  SLOPE* 

5)     How  DID  TUBE  D  ROLL  DOWN  THE  SLOPE  COMPARED  TO  THE  f  ^ 

OTHERS?  V  •'^^ 

's>oeec^  _a-=^  '\V  rdVgd  Ca'sKrr- 

Now  ROLL  TUBE  D  DOWN  THE  SLOPE. 

5)     How  DID  TUBE  D  ROLL  DOWN  THE  SLOPE  COMPARED  TO  THE 
OTHERS? 

^TX-  vAjf=<.v-\Ar    /v^uoK  Jfi^4t=^.r 


/ 

5)     How  DID  TUBE  D  ROLL  DOWN  THE  SLOPE  COMPARED  TO  THE 

OTHERS?  ^  ^ 

i't  /lA^^^J  /rrU^^l  ^Afs'toH  /,^g   ^J- /H^^^j^  K  ■ 
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Elevehth  Grade    Score  Point  2 

How  DID  TUBE  D  ROLL  DOWN   THE  SLOPE  COMPARED  TO  THE  X-r-v  K 

OTHERS?  /  ""^J 


How  DID  TUBE  D  ROLL  DOWN  THE  SLOPE  COMPARED  TO  THE 
OTHERS?  / 


24.'^ 


Third  '*!Ade    Score  Roint  I 


5)     How  DID  TUBE  D  ROLL  DOWN  THE   SLOPE  COMPARED  TO  THE 
OTHERS?  1 


5)     How  DID  TUBE  D  ROLL  DOWN  THE   SLOPE  COMPARED  TO  THE 
OTHERS? 


S?1!eRS?  °  '^"^  "SPARED  TO  TH 


Seventh  ^iRADE    Score  Point  1 


Now   ROLL  TUBE  D  DOWN  THE  SLOPE.""  "  '  " 

5)     How  IllD  TUBE  D   ROLL  DOWN  THE  SLOPE  COMPARED  TO  THE 

OTHERS?  /"Vv. 


Now   ROLL  TUBE  ,D  DOWN   THE  SLOPE. 

5)     How  DID  TUBE  D   ROLL  DOWN  THE   SLOPE  COMPARED  TO  THE 
OTHERS? 


Now  ROLL  TUBE   D  DOWN  THE  SLOPE- 

OTHERS?  ^"^^  ^  ^^^^^  COMPARED  TO  THE  \ 
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Eleventh  Grade   Score  Poim  1 
5)    How.  DID  tu6e  D  roll  down  the  slope  compared  to  the  ' 

OTHERS?  (  O 
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Third  Grade   Score  Point  2 


6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 


6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

OTHER  TUBES.  n  i  OA       /  li  I 


2Ll 


6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

OTHER  tubes. 
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Sevei^  Grade    Score  Poiwt  3 

Explain  vhat  you  found:'  - 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the  , 
other  tubes. 

O    'CoUed  W^rN     <^   b  C  V^PCQC?^< 

^""^     Co  r^^  leteiy  d  cco^  v>v|.  ^  ^^"^  '^N 

Explain  what  you  FniiNp! 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

OTHER  tubes.  .  J        A  -i  l 

Mi?  A^LrMVt  Aj^^ 
^^JfiJ-i     /JAyYiA  /JIX,(MA  t^'^ho  ^do^/rf^A/)0 


Explain  what  you  found! 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

i  OTHER  TUBES.,  ^  n 
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SEVEhTTH  Grade    v'^ore  Point  2 


Explain  what  vou  fdund; 

5)    Explain  why  tube  D  rolled  tf.e  way  it  did  compared  to  the 
other  tubes. 


fv^^rr-.     gSA.-Vri  -AVc^-V  \s  4uV^ 


Explain  what  you  found; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to /fRTSx 

OTHER  TUBES.                                                                                  I  j 
/L.^  hi  J^yrh^  


Explain  what  you  foiinc: 

5)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 
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ELEVEhm  Grade    Score  Point  3 


Explain  what  vnii  FniiNp; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 


tefQc^  -flifu  both   naof  mfii  mm/<:dC^ 

(L  (}i)hM^  -^\urc  ujos^I  a  lor       imnn  — ^ 

Explain  what  you  found; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

other  tubes.  i 

Explain  what  you  found: 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the, 
other  tubes. 


Wcd.^^^  "H<t>f   W^rt.   V\f  ^^^  S(M\fei 


"no 


Eleventth  Grade    Score  Point  2 


EXPLATN   WH^T   YO'f  F""nP- 

0?SeR^?UBeL"'"^'  °  '^''^  COMPARED  TO  THE 


,>9)ara  op^i^r)  l!^  CM^d  (Jai  in.^^  bmj 

Explain  what  you  FofiNp; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes.  \ 

fif/-d  yonrl^  -fhi$  ^h^d^  ^k^^l^i^y^^ 


Explain  what  YouFouNn: 

I  6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 

OTHER  TUBES. 
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Third  ^irade    Score  Point  .1 


6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  Ty^-^ 

OTHER  TUBES.  (      t  ) 


6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 


5)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  t 

OTHER  TUBES.  , 

n\r  \yi\\ 
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Seventh  ^irade    Score  Point  1  ^oxA  G 


Explain  what  you  founh! 

6)    Explain  why.  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 


 uVl^  .^<U4mA  ^a^jLl^A  J^^^ik^Xjz^  ^^tj^  ^ 


Explain  what  you  FonNn; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 


i         Explain  what  you  fou^d- 

6)    Explain  why  tube  D  rolled  t^e  way  it  did  compared  to  the  ^ 
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Eleventh  Grade    Score  Poinh'  1 


Explain  what  you  founh; 

6)    Explain  why  tube  D  rolled  the  way  it  did  compared  to  the 
other  tubes. 

  mji  


Explain  what  you  found: 

6)    Explain  why  .tube  D  rolled  the  way  it  did  compared  to  the- 

OTHER  tubes 


^yyv^^^^  N  -lull  ^         aif^.gS  /J/:rf 

Explain  what  you  found: 

6)'    Explain  why  tube  D  rolled  the  way  it  did  comparrS^-o^  the 


L 


OT^H^TUBES.  {     \    )  ' 
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Comments  on  Sand  and  Tubes  (Grades  3,  7,  and  11) 

This  activity  required  students  to  infer  the  relationship  between  amount 
of  sand  in  each  tube  and  how  fast  it  rolled  by  rolling  each  tube  down  an 
incline  and  observing  the  results.    Students  were  asked  to  note  the  results, 
and  to  formulate  a  hypothesis  about  why  tube  D  (the  empty  tube)  rolled  the  way 
it  did.    While  this  activity  was  well  received,  staff  and  consultants  had 
numerous  suggestions  for  revision.    The  apparatus  seems  extremely  well  suited 
to  making  observations  and  drawing  conclusions  about  the  relationship  between 
the  amount  of  sand  in  the  tube  and  how  fast  it  rolls.    Yet,  no  third  graders 
and  only  a  few  seventh  and  eleventh  graders  explicity  noted  this  relationship. 
This  question,  in  contrast  to  the  Wig-Wag  question  discussed  later  in  this 
section,  did  not  explicitly  ask  students  to  state  the  relationship  or  provide 
a  single  response  space  for  a  summary  statement.    It  was  agreed  by  staff  and 
consultants  that  the  assessment",  should  contain  a  range  from  explicitly  stated 
questions  to  questions  in  which  the  students  are  required  to  infer  the 
relationship  based  only  on  their  observation.    In  the  latter  type,  however, 
care  must  be  taken  that  students  are  not  misdirected  as  might  have  been  the 
case  with  Sand  and  Tubes. 

Some  consultants  felt  it  was  inappropriate  to  ask  why  tube  D  (the  empty 
tube)  should  roll  differently  from  the  tubes  with  sand  because  that  is  an 
extremely  difficult  question.    Others  felt  ^uch  a  question  would  be  good,  as 
it  would  require  students  to  develop  a  hypothesis.    Suggestions  for  questions 
that  could  be  asked  about  tube  D  included  predicting  how  the  tube  might  roll 
compared  to  the  previous  tubes,  or  hypothesizing  about  how  much  sand  was  in 
the  tube  based  on  how  fast  it  rolled.    The  compromise  might  be  to  have 
students  base  their  hypothesis  on  their  observation  and  accept  all  plausible 
hypotheses. 
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Finally,  it  was  suggested  that  this  activity  might  be  group  or  computer 
administered.    This  would  be  more  cost  effective  and  might  provide  a  way  to 
ensure  that  students  do  not  revise  (erase)  their  hypotheses  about  tube  D  based 
on  their  actual  observations.    If  the  apparatus  is  used,  the  tubes  should  be 
made  of  plastic  instead  of  glass. 

In  summary,  the  idea  and  apparatus  for  Sand  and  Tubes  is  appropriate  for 
use  in  an  assessment  at  all  three  grade  levels.    The  format  of  parts  2-4 
should  be  revised  so  that  it  does  not  discourage  students  from  articulating  a 
single  relationship  between  the  amount  of  sand  and  how  fast  the  tubes  roll. 
The  questions  should  also  capitalize  on  the  apparatus  and  ask  students  to 
predict  or  hypothesize  about  tube  D.    A  question  about  why  tube  D  does  not  fit 
the  established  pattern  would  be  acceptable,  if  there  is  a  way  to  record 
students'  initial  hypothesis  about  tube  D.    The  consultants  seemed  quite 
confident  that  students  would  -^rase  these  hypotheses  if  they  diffsred  from 
their  subsequent  observations.    This  activity  should  be  retained  ynd  revised. 
It  could  be  a  computer  simulation  or  administered  using  a  computer  plus  a 
videodisc,  and,  if  not  that,  perhaps  group  administration  with  much  larger 
tubes  for  demonstration  by  the  administrator. 
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GRADES  3,7,11 


STATION  2 


Do  THE  CAN  AND  THE  FUNNELS  ROLL  DIFFERENTLY  AT  POINT  A? 
At  POINT  B? 


Here's  what  you  dq: 

1)  Put  the  can  across  the  two  pieces  of  wood  at  point  A^ 
let  go  and  watch  what  happens. 

2)  Put  the  can  at  point      let  go  and  watch  what  happens. 

3)  Put  the  two  funnels  that  are  stuck  together  at  point  A. 
let  go  and  watch  what  happens. 

^)    Put  the  two  funnels  at  point  B.  let  go  and  watch  what 

HAPPENS  < 


What  did  you  find: 

5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 
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Activity  Identification:    Rolling  Funnels 
Grade(s):  3,7,11 

Method  of  Administration:    Self -Administered  Station  Activity 
Content  Area:    Science-Physics/Mathematics -Geometry 

Apparatus  required:    A  double  cone  made  with  two  identical  plastic  funnels;  a 
wooden  board  with  two  diverging  rails  and  points  at  opposite  ends  lai;elled  A 
and  B;  an  empty  tin  can. 

Administration:    Administrator  should  place  the  board,  can,  and  funnels  on  a 
flat  surface  (table  top)  next  to  the  diverging  rails.    The  can  and  the  funn^rl 
should  be  placed  in  a  stand-up  position. 

Servicing:    None  required 


Scoring  Guide 


Rolling  Funnels 
Station  B 

Grade  3  -  station  2 
7  -  station  2 
11  -  station  2 


Scoring  of  the  Written  Responses 

5)  Score  1  pt.  each  starting  from  score  pt.  2  for  each  accurate  statement 

ots     S?npS?  ''f  '''''''         differently  for  a  maximum  of  3 

pts.    Scoreable  responses  would  include  the  following:  1)  the  funnels  mil 

Score  1  pt.  for  an  inacurate  or  irrelevant  response. 
Score  0  if  the  student  makes  no  response. 
Skills  involved 

«;npr-iJ'Jr^I;h!  ^""^[V^^  ^^e  Student  must  make  comparisons  and  contrasts  between 
specific  observations  (i.e.,  the  can  and  the  funnels). 
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Third  ^irade    Score  Point 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently- 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently' 


D^JJ1reS?lyI"^  ^^"^  "^""""^  ^''^  FUNNELS  ROLLED 

"  ^^^^  CXiTi  L^CIVI    -Po.-s-l-     f^n  0-:<3.nd 
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Sevei^h  Grade    Score  Point  ^ 


5)    Write  down  the  ways  that  the  can  and  the  funnels  kolled 
differently* 

AAA  JO 

5)    Write  dow^i  the  ways  that  the  can  and  the  funnels  rolled 
differently* 


Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 
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Eleventh  Grade    Score  Poitir  it 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  /-pT-  \ 

DIFFERENTLY.  ^   M  V. 

The  Can  irt>{i^  nor-mall  y  CfW-uOOurei  ^   g-V  nO(r\K 
Onrv^  P>.    The  -fijLnn^lv  .-nrf  n-^  rHI    nrv  ^ri^  ."^ %^<^^?i 

5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 

D  IFFERENTLY* 

TU  Cqa  rolls  frDr-^  A   -fo       .     +U    fi/^n^A   nsU  fi^^ 
can  aoe!.  nof         oj-  j^.  u)Ko^         ca^  i;?  pVi^M  ^ 
A  do   r\bi  rail.  


5)    Write  down  the  ways  that  the  can  and  the  funnels  roiled 
differently. 
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Third  Grade    Score  Point 


!!?pILSS"i.V"^  ^'^^^   ^^^^  ^'^N  AND  THE   FUNNELS  ROLLED 

DIFFERENTLY*^^ 


f  ^   n  Jm  nrS^^ 


J. 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  ^ 
differently. 

 f?,ovxYN-A^  rhly  ^^UA>  ^yc>vv\  fito  A.  


5)    Write  down  the  ways  that  ^v-.  can  and  the  funnels  rolled 
differently. 
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SeVEMTH  bRADE     ScORE  PoiNT  3 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 

DIFFERENTLY* 

^^^^    ""^^  •^^^^a^r^ 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 


J^.>>^.  ""(r^Mjli.    A,^>^M  rW^'t 

U^tiX^cL  ^  ^^^^ 

.  cJX  -tla,  ul  r 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 

T  K 

 ^AMt  ^-v-^    A.  ^ 
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Eleventh  tirade    v^core  Pqint  3 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 


y—^  ■  1. 

 feJ242f  ^StkA  i*C4<»^  Mr    k^i^    //  A:/^7fj 

» 

5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 

DIFFEi^ENTLY. 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 
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Third  Grade    Score  Point  2 
5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  n 

DIFFERENTLY.  — 

The —  (Ai^AV  ^r-^,.,f\   


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently.  /\  . 

Tk^tm  r^jled  i^jn 
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■2_, 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  1_ 

DIFFERENTLY,./!  ;^  ^  A — 


Seventh  C^rade    Score  Point  2 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 


5)    Write  down  the  ways  that  the  can  and  the  funnels  roiled' 
differently. 

^jj^uru/      !tteuud  'V^^.      Ji>JAJ  d^fJtrTL. 


5)    Write  down  the  ways  that  the  can  and  the  funnels  Roi..e,D 

DIFFERENTLY. 
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Eleventh  Grade    Score  Point  2 


Write  down  the  ways  that  the  can  and  the  funnels  rolled 

DIFFERENTLY*   ^ 


^^^^^^^^     ^  ^  ^  ■  ■■■■■T-  ri-  1  TT  i^-r-^-  -^n^t 


Write  down  the  wa-s  that  the  can  and  the  funnelj^  .^oll^^d 

DI FFERENTLY* 


Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 


MrUMJx^    X'h^uyy^  -fi.    ^UvL   CQyf^    ^OuQ  ck£UjL. 
McCLLLC-L.  ^^^P''  B  -U^    IjIJUmJ :±hc>yv^   .pj^ij^  •f\  .  266 


Third  ^irade    Score  Point  .1 

5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  | 
differently.  i 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled  I 

DIFFERENTLY.  ' 


5)    Write  down  the  ways  that  the  can  and  the  funnels  rolled 
differently. 
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ELEverm  Grade    Score  Point  1 


5)    Write  down  the  ways  that  the  can  and  the  funnels  roli  ed 
differently. 


D?fJEREN?LYy"'  '''''''                             ''^^           ''"NN^LS  .ROLLED 
-^Sg^  .r^^i^     ^.JiJ^     ^     ^j/  _^ 


D?^JlRESTt!Yl"^  ^"^^  ^"'^^  ^'^'^  '^^^  FUNNELS  ROLLED 
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Eleventh  Grade    Score  Poii^  1 


Write  down  the  ways  that  the  can  and  the  funnels  rolled 

DIFFERENTLY- 

^IM  gT7.Y^  ^>.\^\1r  1^  U)f  rnll^/i 
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Comments  on  Rolling  Funnels  (Grades  3,  7,  and  11)  • 

This  activity  required  students  to  make  observations  and  report  their 
findings.    NAEP's  advisory  panel  liked  the  apparatus  including  the  double  cone 
of  funnels  rolling  uphill,  but  felt  the  questions  should  be  reformulated  to 
assess  how  students  deal  with  a  counterintuitive  situation.  They  felt  that  the 
innovative  apparatus  was  in  a  sense  wasted  by  having  this  activity  be 
ob<^ervationai  only.    Thus,  it  was  suggested  that  after  the  students  roll  the 
can,  they  be  asked  to  predict  how  the  funnel  will  roll.    After  rolling  the 
funnel,  they  might  be  asked  if  they  were  surprised  and  what  they  might  want  to 
do  next  to  see  why  the  funnel  rolled  up  hill. 

The  discussion  for  Rolling  Funnels  was  parallel  to  that  for  Sand  and 
Tubes  regarding  administration  procedures.    The  consultants  had  the  same 
reservations  about  students  erasing  their  predictions  after  the  fact  and 
suggested  that  opportunities  for  them  to  do  this  should  be  avoided.  This 
activity  might  be  group  administered  or  done  by  computer  simulation.    A  group 
administration  would  be  more  cost  effective,  while  the  computer  simulation 
would  provide  a  way  to  record  student  predictions. 

In  summary,  the  questions  should  be  revised  to  use  the  apparatus  in  a  way 
that  capitalizes  on  it's  appropriateness  for  making  predictions.    The  mode  of 
administration  could  be  changed  to  group,  computer  simulation,  or  computer 
with  videodisc. 
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GRADES  3,7 


STATION  5 


How   DOES   THE  WIQ-WAG   MOVE  WITH  THE   DIFFERENT  BLOCKS    IN   THE  TRAY? 


This  is  a  Wig-Wag.    Push  the  end  of  the  tray  sideways  a  bit  and 

THEN   LET  GO.      Do   YOU    SEE   WHAT   HAPPENS?     ThIS    IS   THE   REASON  WE 

CALL  IT  A  Wig-Wag. 

Here's  what  you  do: 

1)  Look  at  the  blocks  labelled  A,       C,  and  D. 

2)  Lift  each  block  one  at  a  time-    What  do  you  notice  about 
the  blocks? 


3)    Put  one  of  the  four  blocks  in  the  tray  and  move  the 
Wig-Wag.    Notice    how  the  Wig-Wag  moves.    Now  try  with 
the  other  blocks. 


Explain  what  you  FoiiNn- 

4)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND   HOW  THE  WiG-WaG  MOVES. 
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Activity  Identification;  Wig-Wag 
6rade(s):  3,7 

Method  of  Administration:    Self -Administered  Station  Activity 
Content  Area:  Science-Physics 

Apparatus  required:    One  inertia  balance,  two  large  C-clamps,  one  block  of 
lead  labelled  A,  one  block  of  aluminum  labelled  R,  one  block  of  wood  labelled 
C    one  block  of  balsa  wood  labelled  D,  pan  scale,  timer,  and  graph  paper. 
(Picture  below  only  shows  one  clamp.)  ^    y  y 

Administration:    The  Wig-Wag  should  be  set  up  using  2  G-clamps  in  opposite 
corners  as  shown  i n  the  di agram  on  the  inside  of  the  box.    The  blocks  should 
be  placed  in  a  standardized,  sequential  order  next  to  the  Wig-Wag. 

Servicing:    None  required 
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Wig-Wag 
Station  B 

Grade  3  -  station  5 
7  -  station  4 

Scoring  of  the  Written  Responsas 

4)    Score  3  points  If  the  student  accurately  notes  the  relationship 
between  the  weight  of  the  block  and  the  rate  of  movement  of  the 
Wig-Wag  (i.e.  the  heavier  the  block,  the  slower  it  moves).  The 
student  may  express  this  relationship  in  a  statement,  a  series  of 
statements,  or  graphically  (note  should  be  taken  if  the  relationship 
is  expressed  graphically).     Score  2  points  if  the  student  only  notes 
that  the  Wig-Wag  moves  differently  with  different  blocks  in  the  tray. 
Score  1  point  if  the  student  makes  an  irrelevant  response.     Score  0 
if  the  student  makes  no  response. 

Skills  involved 

In  this  exercise  students  are  asked  to  hypothesize  the  relationship 
between  weight  and  rate  of  movement.     This  relationship  can  be  deduced  by 
comparing  and  contrasting  how  changes  in  the  independent  variable  (i.e.  the 
weight  of  the  block)  bring  about  changes  in  the  dependent  varlabif  (i.e.. 
rate  of  movement  of  the  Wig-Wag). 
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Third  Grade    Scorc;  Point  5  'V^ojt^  H 

Explain  what  ymt  Fni.K^p. 

^)    Describe  the  relationship  between  the  weight  of  -he 

BLOCKS   AND  HOW  THE  WiG'Wag  MOVES.  ^ 

Explain  what  you  Fnimp. 

^)    Describe  the  relationfhip  between  the  weight  of  the 

BLOCKS  AK'D  HOW  THE  Wig-WaG  MOVES. 

 ^--^  L  /.'^  In-i-  i^Ol'^ 

Explain  what  you  found-  . 

^)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  A^D  HOW  THE  WiG'Wag  MOVES. 


HOW  THE  Wig-Wag  moves.  fj  'Z 
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Seventh  Frade   Score  Point  3 


ERIC 


4)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WIG'WaG  MOVES* 


4)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WiG'WaG  MOVES. 


^)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS   AND  HOW  THE  WiG'WaG  MOVES* 
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Third  Grade    Score  Poif^  2 


Explain  what  yom  pnimn^ 

^)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND,  HOW  THE  Wig-WaG  MOVES. 


^^^^  '^-^l^^  5^cond.  llfWeoA^ 

I 

Explain  what  yoii  Fnl^^|p. 
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Explain  what  you  pniiKjp. 

^)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WiG'Wag   MOVES.  Z. 

— D— ^ao^avg^  'h"^^'f(>y'  


Seventh  '^^rade    Score  Point  2 


i?)    Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WIG-WaG  MOVES. 

CP- 


4)    Describe  the  relationship  BETWEE^'  the  weight  of  the 

BLOCKS  AND  HOW  THE  WiG'Wag  MOVES. 


Describe  the  relationship  between  the  weight  of  the 

-BLOCKS  AND  HOW  THE  WiG'Wag  MOVES. 

/fe  t^^^  '  li^j  ryi^frA    ^uuj/y  ^  ^1^,1, 
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Third '^RADE  !)Core  Point  1 


hum  Mm  m  mm: 

1)  Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WlG'k  HOVES. 


1)  Describe  THE  relationship  BETWEEN  THE  WEIGH]  m 
BLOCKS  m  HOW  THE  WiG'WaG  HOVES.  " 


jpg?  .5 


toliHMJtilNfi! 

1)  Describe  the  relationship  between  the  weisht  m 

BLOCKS  AND  HOW  THE  WlG^AP -"es"  ™ 


^ev.-ih'ipade  Jcore  Point  1 


Describe  the  relationship  between  the  weigjit  of  the 
blocks  and  how  the  ilg'wag  hjves. 

(\  W  CCTN^LS  ^bn  ^l)V 


^i)  Describe  the  relationship  between  the  weight  of  tke 
Blocks  and  how  the  Wig-Kag  moves. 


^)  Describe  the  relationship  between  the  weight  of  the 

BLOCKS  AND  HOW  THE  WlG-k  MOVES. 

VW   \P.^(\^  fvirM)or.(Oit'vl/] 


Comments  on  Wig -Wag  (Grades  3  and  7) 

This  activity  required  students  to  determine  the  relationship  between 
the  weight  of  a  block  and  how  the  Wig-Wag  apparatus  moved.    They  were  asked  to 
make  observations  and  infer  the  relationship.    Despite  the  fact  that  the 
apparatus  for  this  task  weighs  about  10  pounds,  the  activity  was  well  received 
by  the  panel  memberi,  and  appears  appropriate  for  third  and  seventh  graders. 
The  results  indicate  that  third  grade  students  understood  the  task,  in  that 
about  three-foiipths  answered  at  the  minimal  level  or  above.    Almost  two-thirds 
of  the  seventh  (jraders  were  able  to  observe  and  accurately  note  the 
relationship  between  the  weight  of  the  block  and  the  rate  of  movement  of  the 
Wig -Wag. 

The  panel  suggested  that  amplitude  is  also  an  important  aspect  of  this 
acrn'lty  and  that  the  lighter  the  block  the  faster  and  further  the  Wig-Wag 
should  move.    This  should  be  kept  in  mind  when  refining  the  scoring  guide. 

The  panel  also  suggested  that  it  might  help  third  graders  to  write  down 
their  conservations  after  trying  the  first  block.    Thus,  part  three  might  read 
as  follows: 

3)    Put  one  of  the  four  blocks  in  the  tray  and  move  the  Wig-Wag.  Notice 
how  the  Wig-Wag  moves.    Write  down  what  you  saw. 


The  remaining  steps  in  the  task  would  remain  the  same,  but  be  renumbered 
\  accordingly.    In  summary,  this  task  is  recommended  for  use  in  future 

assessmeni:s  either  as  pilot  tested  or  with  slight  modification. 
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GRADE  3 


STATION  1 


You   ARE  GOING   TO   PLAY  THE  CIRCLE  GaWE  WITH   THE  COMPUTEh  -  Th 
COMPUTER  WILL  TELL  YOU  WHAT  TO  DO  AND  YOU  WILL  PUT  ALL  YOUR 
ANSWERS    INTO  THE  COMPUTER. 

Ko^j   TURN  THE  COMPUTER  ON. 


283 


Activity  Identification:    The  Circle  Game 
6rade(s):  3 

Method  of  Administration:    Self-Administered  Station  Acti vity/Computer 
Content  Area:    Mathematics-Numerical  Reasoning 

Apparatus  required:    Apple  II  Series  Computer  with  48k  memory,  diskette  with 
program,  paper  and  pencil. 

Administration:    Administrator  should  type  in  the  student's  code  at  the  onset 
of  each  aGmimstration  and  reset  the  program  at  the  end  of  each  administration. 

Servicing:    None  required 


Self-Administered  Station  Activity-  3 
Circle  Game 

H  ,   Note:  The  computer  will  display  a  row  of  13  circles. 

Who  gets  the  last  circle? 
The  last  circle  loses. 

How  many  circles  do  you  want  (1  or  2)? 
Press  the  number  on  the  keyboard. 

Note:    The  computer  will  cross  out  the  number  of  circles  that  the  student 
chooses  with  vertical  hatch  marks. 

The  computer  takes  (some  number)  circles. 

Note:    Circles  chosen  by  the  computer  will  be  crossed  out  with  horizontal 
hatch  marks. 

Do  you  see  how  to  play? 

Press  Y  for  yes.    Press  N  for  No. 

Note:    If  student  presses  Y,  the  game  will  proceed.  If  student  presses  N  the 
program  will  display  the  following  prompt  and  start  the  proo-am  from  the 
beginning. 

Okay,  let's  go  over  it  again. 

^  Note:    If  the  student  presses  Y  the  program  will  display  the  following  prompt, 

Do  you  want  to  go  first  or  should  the  computer  go  first. 
Press  M  for  yourself. 
Press  C  for  the  computer. 

(After  the  student  has  made  a  response)  How  many  circles  (1  op  2)? 

The  computer  takes  (some  number)  circles. 

Note:    After  each  game  the  computer  will  display  one  of  the  followino 

The^computer  will  then  display. 

You're  a  good  person  to  play  against.    Let's  play  again. 

games.  "'^^  ^'^  ^^'^       ^^e  first  game  for  4  more 

Probe  questions  to  follow  the  game-  3 

>  tte'cj^Ser  star"!'""'"  """'^  "  ^o"  <>■■ 

Press  Y  for  yes.    Press  N  for  no. 
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If  you  pressed  Y,  who  would  you  want  to  go  first?    Press  M  for  yourself. 
Press  C  for  the  cofiiputer. 

(If  the  student  pressed  N,  program  should  go  to  the  next  question) 

If  there  were  three  circles  left  and  it  was  your  turn,  how  many  would  yo 
need  to  cross  out  to  be  sure  to  win? 

Press  1  for  one  circle.    Press  2  for  two  circles.    Press  N  if  you  do 
not  think  that  you  could  be  sure  to  win  if  there  were  three  circles 
left. 

If  there  were  four  circles  left  and  it  was  your  turn,  how  many  would  you 
need  to  cross  out  to  be  sure  to  win? 

Press  1  for  one  circle.    Press  2  for  two  circles.    Press  N  if  you  do 
not  think  that  you  could  be  sure  to  win  if  there  were  four  circles 
left. 

Thank  you.    It's  been  fun. 
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The  Circle  Game 
Station  B 

Grade  3  -  station  1 


Only  responses  to  questions  be  scored,  but  a  tally  and  notes  will  be 

kept  on  evidence  of  developing  strategies  and  inconsistencies  in  sampling 
benavior*  ° 

1)  Is  there  a  way  you  can  play  so  that  you  can  be  sure  of  winnine^^ 
Score  2  pts.  for  Y  (yes). 

Score  1  pt.  for  N  (no). 
Score  0  for  no  response. 

2)  Does  it  make  a  difference  in  your  chance  of  winning  whether  you  start 
or  the  computer  starts?    If  you  pressed  Y,  who  would  want  to  go  first^ 
Score  3  pts.  for  Y  followed  by  C  (computer). 

Score  2  pts.  for  Y  followed  by  M  (myself). 
Score  1  pt.  for  N  (no). 
Score  0  for  no  response. 

3)  If  there  were  3  circles  left  and  it  was  your  turn,  how  many  would  you 
need  to  cross  out  to  be  sure  to  win? 

Score  3  pts.  for  2. 
Score  2  pts.  for  1. 

Score  1  pt.  for  N  (You  can't  be  sure  to  win). 
Score  0  for  no  response. 

4)  If  there  were  four  circles  left  and  it  was  your  turn,  how  many  would 
you  need  to  cross  out  to  be  sure  to  win? 

Scor<^  3  pts.  for  N  (You  can't  be  sure  to  win). 
Score  2  pts.  for  2. 
Score  1  pt.  for  1. 
Score  0  for  no  response. 

Skills  involved: 

In  this  exercise  students  need  to  formulate  hypotheses  and  develop  a 
strategy  to  solve  a  mathematical  problem. 
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Comments  on  the  Circle  Game  (Grade  3) 

This  is  a  computer-administered  game  of  strategy  requiring  numerical 
reasoning.    In  the  game  the  computer  displays  13  circles.    The  student  and 
computer  take  turns  crossing  out  one  or  two  circles  until  the  player  forced  to 
cross  out  the  thirteenth  one  loses.    After  a  practice  game,  the  student  plays 
four  games.    !n  each  game,  the  student  chooses  whether  to  go  first  or  have  the 
computer  begin.    Finally  the  student  is  asked  four  questions  which  try  to 
probe  the  student's  understanding  of  what  is  needed  to  win  and  whether  the 
student  has  developed  a  winning  strategy. 

Because  there  is  a  strategy  by  which  a  player  can  always  win  when  the 
other  player  starts,  the  computer  has  been  prograrmied  to  use  this  strategy  and 
to  win  whenever  the  student  elects  to  go  first.    When  the  computer  is  told  to 
start,  it  has  been  programmed  to  cross  out  one  or  two  circles  randomly  so 
that,  depending  on  the  student's  strategy,  the  computer  may  win  or  lose. 

Unfortunately,  almost  half  the  data  was  lost  when,  for  some  unclear 
reason,  most  of  the  student  responses  were  not  recorded  on  the  disk  while  the 
students  were  playing. 

Based  on  review  of  the  limited  records  on  the  disks,  it  seems  that  the 
student  understood  how  to  play.    Although  there  was  little  evidence  that  these 
students  recognized  a  winning  strategy,  about  20  percent  played  at  least  one 
"perfect"  game  (i.e.,  the  student  used  the  same  strategy  when  the  computer 
started  as  the  computer  was  programt.ied  to  use  when  the  student  started). 
According  to  the  administrators,  the  students  enjoyed  the  task,  although  they 
reported  that  the  8  minutes  allowed  was  coo  little  time.    The  reports  of 
insufficient  time  were  supported  by  the  limited  data  obtained.    A  longer  time, 
probably  10  minutes,  is  suggested. 
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The  program  also  needs  revision.    Some  suggestions  for  revisions  are  to 
tell  students  at  the  beginning  that  there  will  be  questions  to  answer  after 
the  game;  to  reverse  the  order  of  questions,  asking  the  strategy  questions 
after  the  specific  ones  about  who  would  win;  and  to  provide  a  continuous 
display  of  the  goal  of  the  game  on  tfie  screen. 

In  summary,  the  task  appears  appropriate  for  third  grade.    However,  NAEP 
needs  to  revise  the  program,  determine  appropriate  time  requirements,  and 
develop  a  better  understanding  of  the  operational  constraints  of  computer 
administrations.    This  task  requires  further  pilot  testing. 


2Sf} 


GRADES  7,n 


STATION  1 


You   ARE   GOING   TO   PLAY   THE   NUMBER   GaME   WITH   THE   COMPUTER.  ThE 
COMPUTER  WILL   TELL   YOU  WHAT  TO  DO  AND  YOU  WILL   PUT  ALL  YOUR 
ANSWERS    INTO   THE  COMPUTER. 
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Activity  Identification:    The  Numbers  Game 
Grade(s):  7,11 

Method  of  Administration:    Self-Administered  Station  Activity/Computer 
Content -Area:    Mathematics-Numerical  Reasoning 

Apparatus  required:    Apple  II  Series  Computer  with  48k  memory,  diskette  with 
program,  paper  and  pencil 

Administration:    Administrator  should  type  in  the  student's  code  at  the  onset 
of  each  admimst ratio,',  and  reset  the  program  at  the  end  of  each  administration, 

Servicing:    None  required 


Ptms  the  RETURN  iii/:^^^i^k 


'  enter,  a '  number  'or  -  mgmii0 
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Self -Administered  Station  Activity-  7,11 


You  are  about  to  play  the  Numbers  Game.    You  will  be  playing  against  the 
computer.    You  will  play  one  practice  game  to  get  you  acquainted  with  the 
object  and  rules  of  the  game.    Then  you  will  play  a  few  games  for  real  against 
the  computer. 

The  Numbers  Game  begins  with  the  number  0.    Each  player  then  gets  a  turn 
to  add  1  or  2  to  that  number.    The  object  of  the  game  is  to  force  the  other 
player  to  reach  or  exceed  unlucky  13. 

(Practice  game  1)  Okay,  let's  try  a  practice  game.  Do  you  want  to  go  first  or 
should  the  computer  start?    Press  M  for  yourself.    Press  C  for  the  computer. 

(For  the  student's  turn) 

Add  either  1  or  2  to  this  number  by  pressing  1  or  2  on  the  keyboard. 

(For  the  computer's  turn) 
The  computer  adds  (1  or  2). 

Note:  After  the  game  has  been  completed  the  computer  will  display:  Hooray, 
you  win!  (if  the  student  wins)  or  Sorry,  maybe  you'll  win  another  time!  (if 
the  computer  wins ) . 

Now  you  are  ready  to  play  the  real  game.    Do  you  want  to  go  first  or 
should  the  computer  go  first?    Press  M  for  yourself.    Press  C  for  the 
computer. 

Note:    Program  will  proceed  with  the  prompt  asking  the  student  to  make  a  move 
(if  the  student  pressed  M)  or  with  the  prompt  telling  the  student  which  number 
the  computer  wants  to  add  (if  the  student  pressed  C)  as  in  the  practice  game. 

Probe  questions  to  follow  the  game'7,11 

If  you  start,  can  you  play  so  that  you  always  will  win? 
Press  Y  for  yes«    Press  N  for  no. 

If  the  computer  starts,  can  you  play  so  that  you  will  always  win? 
Press  Y  for  yes.    Press  N  for  no. 


If  the  computer  says  11,  who  will  win? 

Press  M  for  yourself.  Press  C  for  computer. 
Suppose  the  game  is  played  so  that  each  player  can  add  1,  2  or  3  at  each 
turn.  Mhat  is  the  highest  number  below  12  you  can  reach  and  be  sure  of 
winning? 

Press  this  number  on  the  keyboard. 
Thank  you.    It's  been  fun. 
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Comments  on  the  Numbers  Gr!>  ■     '  ades  7  and  11) 

This  exercise  is  a  computer-administereu        rical  reasoning  game  based 
on  the  mathematical  game  NIM^  and  similar  to     .      xle  Game  for  grade  3.  At 
grades  7  and  11,  the  game  is  explained  in  words  on  the  computer  screen  and 
students  play  without  the  visual  aid  of  the  circles  being  crossed  out.  The 
questions  after  the  games  are  also  different^ 

In  administration,  there  were  the  same  problems  of  unrecorded  data  with 
this  task  as  with  the  Circle  Game.    Only  42  cases  survived  at  grade  7  and  61 
cases  at  grade  11.    Among  the  students  for  whom  there  was  data,  only  30 
percent  of  grade  11  students  completed  the  task  while  55  percent  of  the  grade 
7  students  did.    In  grade  11,  5  students  seemed  to  recognize  the  game,  using 
the  same  winning  strategy  throughout. 

The  advisory  panel  who  reviewed  the  program  and  the  data  liked  the  task 
and  the  inclusion  of  computer-administered  exercises.    However,  as  for  all  the 
computer-administered  exercises,  revisions  of  the  program  are  necessary  and 
new  pilot  testing  of  the  revised  program  would  be  needed  before  any 
operational  use.    Also,  students  should  be  given  more  time  to  complete  the 
exercise. 
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GRADE  3 


STATION  6 


What  happens  when  you  put  water  on  these  things? 

Here's  what  you  do: 

1)  Place  a  drop  of  water  on  each  material. 

2)  Look  carefully.    What  do  you  see? 

Write  down  what  happens  to  the  water  on  each  of  the 
materials. 


A) 

Plastic 

B) 

Painted  wood 

C) 

Brick 

D) 

Metal 

E) 

Roof  shingle 

F) 

Glass 

Now 

USE  your  magnifying  glass  and  look  at  each  material 

very  closel". 

4)  Look  at  the  material  in  the  plastic  bag  very  closely* 

Do   NOT  OPEN   THE  BAG. 

5)  Write  down  what  you  think  would  happen  if  you  put  a  drop 
of  water  on  the  material  in  the  bag. 


Explain: 

6)    Write  down  why  you  think  this  will  happen. 
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Activity  Identification:    Water  on  Brick 


Grade(s):  3 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Science-Physical  science 

Apparatus  required:    Eyedropper,  small  bottle  filled  with  water;  small 
equal-sized  pieces  of  plastic,  painted  wood,  brick,  metal,  roof  shingle,  and 
an  unknown  material  (piece  of  porous  cinder  block)  in  a  transparent,  plastic 
bag;  magnifying  glass,  paper  and  pencil. 

Administration:  The  Administrator  should  keep  the  level  of  the  water  in  the 
dropping  bottle  filled  for  each  administration.    Excess  water     lould  be  wiped 
off  all  the  surfaces  after  each  administration  for  each  child.    The  brick  and 
roof  tile  should  be  replaced  after  every  other  administration  if  possible. 
All  materials  should  be  turned  over  after  they  have  wiped  off  before  each 
administration. 

Servici ng :    None  required 


Warer  on  the  Brick 
Statilon  A 

Grade  3  -  station  6 


Scoring  of  zYie:  Written  Responses 

2)    Score  1  pt,  for  each  accurate  (or  seemingly  plausible)  observation 
starting  with  code  pt.  2  of  how  the  waters  act  on  each  of  the 
materials. 

a)  Plastic  -  runs  off  or  remains 

b)  Wood  -  drop  remains 

c)  Brick  -  drop  soaks  In 

d)  Metal  -  drop  remains 

e)  Rocf  shingle  -  drop  soaks  In 

f)  Glass  -  drop  remains  (spreads) 

Score  1  pt,  for  a  set  of  Irrelevant  responses  (l,e*  "yes",  "no"). 
Score  0  If  the  student  makes  no  response, 

5)  Score  2  pts.  If  the  student  provides  a  reasonable  hypothesis  about 
how  the  water  will  act  on  the  unknown  material;  l,e.  It  will  soak  In 
It  will  be  absorbed.    Score  1  pt..  If  the  student  provides  an 
erroneous  hypothesis  about  how  the  water  will  act  on  the  unknown 
material.     Score  0  if  the  student  makes  no  response, 

6)  Score  2  pts,  if  the  student  is  able  to  provide  a  plauslu  j  reason  or 
set  of  reasons  why  the  water  will  act  a  certain  way  on  the  unknown 
material;  i.e.  It  will  act  like  the  brick  because  it  looks  like  it's 
made  of  the  same  material.    Score  1  pt.  if  the  student  responds  but 
does  not  provide  a  plausible  reason  why  the  water  will  act  a  certain 
way  on  the  unknown  material.     Score  0  If  the  student  makes  no 
response , 

Skills  involved 

In  this  exercise  the  student  needs  to  generalize  Inferences  about  a 
known    set  of  entitles  to  an  "unknown,"    The  basis  for  this  generalization 
are  the  comparisons  and  contrasts  made  among  the  "known"  stimuli. 
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Third  Grade    Score  Point  I 


1)  Place  a  drop  of  water  on  each  material* 

2)  Look  carefully.    What  do  you  see? 

Write  down  what  happens  to  the  water  on  each  of  ihe 
materials' 


A) 

B) 


Plast: c 

Painted  mats  ^  r/F'-^  ^    A  qr  '^<?  >^- 

C)  Brick     -X--^    Q -R  j-      (S  iH -f  rP  ,  { ^ 

D)  hptai   ai-t-c/z^-f  Br  i(7h-t-^r>. 

E)  Roof  shingle 


^  r  /  g  n  -r  7^  />. 


F)  Glass 

Third  Grade    Score  Point  5  ' 

1)  Place  a  drop  of  water  on  each  material. 

2)  Look  carefully-    What  do  you  see? 

Write  down  what  happens  to  the  water  on  each  of  the 
materials- 

A)    Plastic  nu4/l^iA 


B) 


Painted  wood 


C)  Brick 


D) 


Metal      (f  J7^f  mA^h]  V^A 


E)    Roof  shingle  . 


F)    Glass  . 


Third  Grade    Score  Point  7 

1)  Place  a  drop  of  wa^er  on  each  mat' 

2)  Look  carefully-    Wkat  do  you  see? 

Write  down  what  happens  to  the  water  on  each  of  the 

MATER  I ALS - 


A) 
B) 
C) 
D) 


Plastic    /Qq/^/]^  knfp^v^<  ^ 

Painted__wood  r?arh,/y  k^*OYY^^  

Brick  J^-r    -fiadlf.^    <r^    ypU     czot^^-J-     <cz^  t\/ 

Metal  Th<^        dr^p  kccnv^ni^  O-^Circ/^/ 

E)    Roof  shingle    LV -Cci.H^.<.  you    Cn^  ^  , 

o     •  Glass   ^-j^     f>k\y^       J-Aa  -b^^^ 
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Third  Grade    Score  Point  2 


5)    Write  down  what  you  think  would  happen  if  you  put  a  drop 

OF  WATER  ON  THE  MATERIAL    IN   THE  BAG 


5)    Write  down  what  you  think  would  happen  if  you  put  a  drop 

OF  W^TER  ON  THE  MATERIAL    IN   THE  BAG.  , 


^6 


I 


n 
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Third  ^irade    Score  Point  1 


5)    Write  down  what  you  think  would  happen  if  you  put  a  drop 

OF  WATER   ON  THE  MATERIAL    IN  THE  BAG. 


5)    Write  down  what  you  think  would  happen  if  you  put  a  drop 

OF  WATER  ON  THE  MATERIAL    IN  THE  BAG. 


5)    Write  down  what  you  think  would  happen  if  you  put 

OF  WATER  ON  THE  M/^TERIAL    IN  THE  BAG.  a 


er. 


ERIC 
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Thi'rd  Grade    Score  Point  2 


EXPLAIN! 

6)    Write  down  why  you  think  this  will  happen- 

0  bj^'^+ '  ' 


EXPLAIN! 

6)    Write  down  why  you  think  this  will  happen. 


lie   uunii   wnr    tuu    inipiN    inis    WILL    MAKKtM'       »  i 


Explain! 

6)    Write  down  why  you  think  this  will  happen.  . 

-fAe  yc'tc^k^  


Third  Srade    Score  Point  1 


EXPLAIN! 

6)    Write  down  why  you  think  this  will  happen.  if  \ 

\V/:f-h  -P-     r,  l-i^q         >h  tfrzr^. 


EXPLAIN! 


6).    Write  down  why  you  think  this  will  happen.  /^i 


iXEixAjji: 

6)    Wri^te  down  why  you  think  this  will  happen. 
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Comments  on  Water  on  Brick  (Grade  3) 

Part  2  of  this  exercise,  which  calls  for  careful  observation  and 
reporting  of  what  happens  to  a  drop  of  water  on  different  materials,  appears 
to  be  appropriate  for  grade  3  students.    The  33  percent  who  reported 
accurately  on  all  six  substances  may  be  an  underestimate  because  some  of  the 
roof  tiles  (shingles)  provided  to  the  project  in  the  sets  of  materials  had  not 
been  thoroughly  cleaned  which  may  have  affected  what  happened  to  the  water 
when  it  was  dropped  on  the  tile. 

Unfortunately,  the  unknown  material  in  the  bag  was  most  like  the  roof 
tile.    Because  we  do  not  know  how  many  children  had  the  poor  roof  tile 
specimens  or  how  many  dropped  water  on  them  in  the  area  where  it  would  not 
soak  in,  there  is  no  way  to  tell  to  what  extent  the  31  percent  who  answered 
part  5  correctly  also  is  an  underestimate.    In  spite  of  this,  the  data 
indicates  that  the  percent  of  students  who  observed  and  formed  an  accurate 
hypothesis  about  what  would  happen  with  the  material  in  the  bag  was  greater 
than  the  18  percent  who  gave  a  plausible  reason  for  what  would  happen. 

In  spite  of  the  roof  tile  problem,  the  project  staff  and  the  advisory 
panel  concluded  that  this  task  could  be  used  in  a  future  assessment  without 
any  change,  except  to  ensure  the  usage  of  new  roof  tiles.    Also,  because  this 
Lask  was  based  on  one  used  in  the  APU  science  assessment  at  age  13,  it  was 
decided  that  this  task  also  could  be  used  for  grade  7  without  pilot  testing. 
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GRADES  7,11 


STATION  6 


How  CAN   YOU  BALANCE  THE  BALANCE  BEAM? 


Pivot  point 


Balance  beam—) 
n     »     2     3     4  6 


Balance  pan 


*l  J,  J,   J.  J,  >!>  i. 


Here's  what  you  do: 

1)  Place  one  washer  on  the  balance  pan.  On  which  hook, 
counting  to  the  right  from  the  pivot  point,  must  you 
hang  one  washer  to  make  the  balance  beam  level? 


2)     Now  REMOVE  THE  WASHER  FROM    THE  BAL/,NCE   PAN  AND   PUT  THE 

PLASTIC  CYLINDER  ON  THE  PAN*  If  T.-.E  MASS  OF  EACH  WASHER 
IS  10   GRAMS,   WHAT   IS  THE  MASS   OF  THE   PLASTIC  CYLINDER? 


3)     How  MANY  WASHERS   DID  YOU  USE  AND  ON  WHICH  HOOK(s)  DID 
YOU  HANG  THEM? 


303 


Activity  Identification:    Balance  Scale 
Grade(s):    7,  11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:  Science-Physics 

Apparatus  required:    A  balance  scale  set  up  and  balanced  with  equally  spaced 
holes  for  hooks  as  shown  in  the  diagram  below,  five  10  gram  metal  washers,  one 
30  gram  plastic  canister;  paper  and  pencil. 

Administration:  Weights  should  be  placed  next  to  the  balance  scale  before  the 
onset  of  each  admini st  rat  i  on  * 

Servicing:    None  required 


Balance  Scale 
Station  B 

Grade  7  -  station  6 
11  -  station  6 


Scoring  of  the  Written  Responses 

1)  Score  2  pts.  If  the  student  provides  the  correct  answer  3,     Score  1 
pt.  If  the  student  makes  an  Incorrect  response.     Score  0  If  the  student  makes 
no  response  or  Indicates  that  she  or  he  doesn*t  know  the  answer, 

(grade  7) 

2)  Score  2  pts.  If  the  student  states  that  the  mass  of  the  plastic 
cylinder  Is  30g.  Score  1  pt.  If  the  student  makes  an  Incorrect  response* 
Score  0  If  the  student  makes  no  responsa. 

(grade  11) 

2)  Score  2  pts.  If  the  student  states  that  the  mass  of  the  plastic 
cylinder  =  3  washers.     Score  1  pt.  If  the  student  makes  an  Incorrect  response. 
Sc  ore  0  If  the  student  makes  no  response, 

3)  Score  2  pts.  If  the  student  provides  a  response  that  would  balance  the 
scale,     Accpptable  responses  Include  the  following:     3  on  peg  3;   1  on  peg  1,  1 
on  peg  2,  2  on  peg  3;  1  each  on  pegs  1,3,  and  5;  1  each  on  peg-s  2,  3,  4;  1  on 
peg  3,  1  on  peg  6;  1  on  peg  4,  1  on  peg  5;  1  on  peg  1,  1  on  peg  2,  1  on  peg  6* 

Score  1  pt.  If  the  student  provides  an  Irrelevant  or  Incorrect 
response.     Score  0  if  the  student  makes  no  response  or  Indicates  that  she  or 
he  doesn't  know  the  answer. 

Note  to  scorers:     Any  Instances  where  the  student  has  balanced  the  scale 
correctly  In  3)  but  misinterpreted  the  Implications  In  2  should  be  recorded. 
Students'  responses  to  3  also  should  be  recorded. 

Skills  Involved 

In  this  exercise  students  need  to  determine  the  relationship  between  two 
variables.    This  determination  needs  to  be  made  by  simultaneous  mt^nlpulatlon 
of  variables  and  also  by  holding  one  of  the  variables  constant. 
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Seventh  Grade    Score  Point  X 


Place  one  washer  on  the  balance  pan.    On  which  hook,     /  o  ^ 

COUNTING  TO  THE   RIGHT  FROM  THE   PIVOT  POINT,   MUST  YOU  ^ 
HANG  ONE  WASHER  TO  MAKE  THE  BALANCE  BEAM  LEVEL? 


Place  one  washer  on  the  balance  pan.  On  which  hook, 
counting  to  the  right  from  the  pivot  point,  must  you 
hang  one  washer  to  make  the  balance  beam  level?  /''"^x 


Place  one  washer  on  the  balance  pan-  On  which  hook, 
counting  to  the  right  from  the  pivot  point,  must  you 
hang  one  washer  to  make  the  balance  beam  le/el? 
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Eleventth  Grade    Score  Point  2 


coSSI,  „"r„?''„™^„„»„'^?K",""-    On  wh.ch  hook, 

HAN.   ONE  WASHER  ?^°HlKE"?!:E'BAM^fc^rBEArL'EV^L"" 


1)  Place  one  washer  on  the  balance  pan.  On  which  hook, 
counting  to  the  right  from  the  pivot  point,  must  yql 
hang  one  washer  to  make  the  balance  beam  level?    /  7^ 


1) 


^omP^  WASHER  ON  THE   BALANCE   PAN.      On  WHICH  HOOK 

COUNTING  TO  THE  RIGHT  FROM  THE  PIVOT  POINT  MSsnoi'l 
HANG   ONE   WASHER   TO  MAKE  THE   BALANCE   BEAM  LEVEL? 
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I 

.  Seventh  ^iRADe    Score  Point  1 

•  1)  Place  one  washer  on  the  balance  pan.  On  which  hook^ 
counting  to  the  right  from  the  pivot  point^  must  you 
hang  one  washer  to  make  the  balance  beam  lcvel? 

0 


1)    Place  one  washer  on  the  balance  pan-    On  which  hook, 

COUNTING  TO  THE  RIGHT  FROM  THE  PIVOT  POINT,  MUST  YOU 
HANG  ONE  WASHER  TO  MAKE  THE  BALANCE  BEAM  LEVEL? 

 ^AA^^Ii^  ./YMt^      ^  k-t  


1)    Place  one  washer  on  the  balance  pan.    On  whith  unntt 

COUNTING  TO  THE  RIGHT  FROM  THE  piO^T  PO^N^"  SJs^  ?0U 
HANG  ONE  WASHER  TO  MAKE  THE  BALANCE  BEAfS   LEVEL?  / 


ERIC 
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Eleventh  Grade    Score  Point  1 


1)  Place  one  washer  on  the  balance  pan.  On  which  hook, 
counting  to  the  right  from  the  pivot  point,  must  you 
hang  one  washer  to  make  the  balance  beam  level?        /  , 


coSSriSf  Tr?Mp'o?!!u^"'  ^"^^^""^  P'^N.    On  which  hook, 

uuuNiiNG  TO  THE  RIGHT  FROM  THE  PIVOT  POINT  MUST  ya!t~ 
HANG   ONE  WASHER  TO  MAKE  THE  BALANCE  BEAM  LEVEl'    7  - 


ERIC 
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2) 


v^EVENTH  ^^RADE     ScORf  PoiNT  2 


Now  REMOVE  THE  WASHER  FROM  THE  BALANCE  PAN  AND  PUT  THE 

?S   10''rRAM^''2u^T°?  ^'^SS  0?   EACH  wIsHER 

IS   lU   GRAMS,   WHAT   IS  THE  MASS   OF  THE   PLASTIC  CYLINDER'?  C 

3  O 


2)     Now  REMOVE  THE  WASHER  FROM  THE  BALANCE  PAN  AND  PUT  THE 

PLASTIC  CYLINDER  ON  THE  PAN-  If  THE  MASS  OF  EACH  WASHER 
IS   10   GRAMS,   WHAT   IS  THE  MASS  OF  THE   PLASTIC  CYLINDER? 


2)     Now  REMOVE  THE  WASHER  FROM  THE  BALANCE  PAN  AND  PUT  THE 

PLASTIC  CYLINDER  ON  THE  PAN*  If  THE  MASS  OF  EACH  WASHER 
IS  10   GRAMS,  WHAT   IS  THE  MASS   OF  THE  PLASTIC  CYLINDER? 


ERIC 
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Eleventh  Grade    Score  Point  2 


P?AS?fr°rv,  1"^  ^^^"^'^  '^^"^  THE  BALANCE  PAN  AND  PUT  THE 
MANY  WASHER^f  "'^  PLASTIC   CYLINDER   Is  HOW 


Now   REMOVE   THE  WASHER   FROM  THE   BALANCE   PAN  AND  PUT  THE 

UN??  i  sisr°TH.°:;  ™'     "^"-^  the"«Ser  «  your 

Zll  SaSHERS?  °'  '"-"'■^  '5  HOW 
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Seventh  ^irade    Score  Point  1 


Now   REMOVE   THE  WASHER   FROM  THE  BALANCE   PAN   AND   PUT  THP 
PLASTIC  CYLINDER  ON  THE   PAN.      If  THE  MASS  0^  EACH  wIshV- 
IS   10   GRAMS.  WHAT   IS  THE  MASS  OF  THE   PLASTIC  CYLINDER?/^^ 


Now   REMOVE  THE  WASHER  FROM  THE  BALANCE   PAN  AND  PUT  THE 
PLASTIC  CYLINDER  ON  THE   PAN-      If  THE  MASS  OF   EACH  WASHER 
IS   10   GRAMS.  WHAT   IS  THE  MASS  OF  THE   PLASTIC  CYLIND 


n 


Now   REMOVE  THE  WASHER  FROM  THE  BALANCE   PAN  AND  PUT  THE 
PLASTIC  CYLINDER  ON  THE   PAN-      If  THE  MASS  OF   EACH  WASHEJ 
IS   lU   GRAMS.   WHAT   IS  THE  MASS  OF  THE   PLASTIC  CYLINDER? 

 ^0    Orvr^w^A■  .  
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ELEVE^rTH  Grade    Score  Poir^  1 


2) 


2) 


\ 


Er|c  313 


Seventh  Grade    Score  Point  2 


YOU  hJUg  ?hEM?''^  '^^^  HOOK(S)  DID 

S  ?JeS!!^°^°  ^^'^  °^  ;"^CH  HOOKCS)  DID 
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ELEVEhfTH  Grade    Score  Point  2 


y"o^  Tul  THi:r'  ^"^^H   HOOK(S)  DID 

-you  hook 


3)      How  MANY  WASHERS  DID  YOU  USE  AND  ON  WHICH   HOOK(s)  DID 
YOU   HANG  THEM? 

^    -  o\At  QiA  ^  5    curd  I  on 
or  3  -    1)  ONA  "^3 


3)      How  MANY  WASHERS  DID  YOU  USE  AND  ON  WHICH  HOOK(s)  DID 
YOU   HANG  THEM? 
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Seventh  Grade    Score  Point  1 


3)     How  MANY  WASHERS  DID  YOU  USE  AND  ON  WHICH  HOOK(s)   D  I  D  -i.,^ 
YOU   HANG^THEM?  /r  ^ 

3)     How  MANY  WASHERS  DID  YOU  USE  AND  ON  WHICH   HOOK(s)  DID 

YOU   HANG  THEM?  ^  ^ 

— 3  .  03- 


3)     How  MANY  WASHERS  DID  YOU  USE  AND  ON  WHICH  HOOK(s)  DID 
YOU   HANG  THEM? 


ERIC 
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Eleventh  Grade    Score  Poim- 1 


3)      How  MANY  WASHERS  DID  YOU  USE  AND   ON  WHICH  HOOK(s) 
YOU   HANG  THEM? 


3)     How  MANY  washers   DID  YOU  USE  AND   ON  WHICH  HOOK(s)  DID 
YOU  HANG  THEM? 


X  used   Buxxshgrs^  PigoinQ  -fhervi  or\  4Hl    1^ ,  ^""-^ ,  cxnci  k 


3)     How  MANY  washers  DID  YOU  USE  AND  ON  WHICH  HOOK(s)  DID 
YOU  HANG  THEM? 


ERIC 
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Comments  on  Balance  Scale  (Grades  7  and  11) 

In  this  exercise,  the  balancing  required  to  answer  the  questions  can  be 
done  by  trial  and  error.    However,  the  solution  to  Part  2  requires  some 
interpretation  of  what  the  balancing  results  imply  about  the  mass  of  the 
plastic  canister.    Part  3  was  included  to  gather  information  about  the  various 
ways  in  which  the  students  obtained  the  balance  and  to  find  out  how  many  were 
able  to  balance  the  scale  but  misinterpreted  the  result  when  determining  the 
mass  of  the  canister. 

One  problem  with  this  exercise  is  that  there  is  no  way  of  knowing  whether 
the  students  who  used  hooks  2,  3,  and  4  or  any  other  combination  of  3  washers 
that  worked,  such  as  1,  3,  and  5  or  1,  2,  and  6,  understood  how  to  interpret 
this  or  simply  answered  30  grams  because  they  used  three  10-gram  washers. 
Those  students  who  used  only  two  washers  for  balancing  clearly  knew  what  they 
were  doing  if  they  gave  the  correct  mass,  but  the  2-washer  solutions  were  more 
prone  to  misinterpretation.    If  this  task  is  to  be  used  in  the  future, 
students  should  be  asked  to  explain  how  the  configuration  of  washers  they  used 
led  to  the  mass  they  reported. 

In  conclusion,  this  exercise  should  not  be  used  in  a  future  assessment  as 
it  was  pilot  tested  even  though  the  panel  did  like  the  idea.    If  the  idea  is 
to  be  used  as  the  basis  for  an  exercise,  the  design  of  the  balance  scale  must 
be  improved  to  make  it  less  fragile.    Also,  the  exercise  must  be  revised  to 
avoid  the  present  possibility  of  arriving  at  a  correct  result  with  erroneous 
thinking.    Any  revised  exercise  would  need  some  new  pilot  testing. 


GRADES  3,7,  n 


STATION  5 


How  MANY  BLOCKS   ARE    IN   THE  STAIRCASE? 
HeRE^S   what   you  DO: 

1)  Look  at  the  "staircase"  of  blocks. 

2)  The  staircase  is  ^  blocks  high.    How  many  blocks  are  in 
the  staircase? 

3)  how  many  blocks  would  be  in  a  staircase  5  blocks  high? 
how  did  you  figure  out  your  answer? 


^)      How  MANY   BLOCKS  WOULD   YOU   NEED   TO   BUILD  A   STAIRCASE  10 
BLOCKS   HIGH?     HoW   DID   YOU    FIGURE   OUT   YOUR  ANSWER? 


5)    What  is  the  relationship  between  the  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it? 
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Activity  Identification:    Double  Staircase 
Grade(s):  3,7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Mathemat i cs-Al gebra 

Apparatus  required:    "Double  staircase"  of  wooden  blocks  that  is  4  blocks 
high,  and  glued  to  a  wooden  base;  24  loose  wooden  blocks  that  are  identical  to 
those  used  in  the  staircase;  graph  paper  and  pencil. 

Administration:    Loose  blocks  should  be  placed  alongside  the  staircase  after 
every  administration. 

Servicing:  Potential  re-gluing  of  blocks  onto  staircase  if  they  should  becoh^e 
loosened  or  dislodged  from  the  base. 


Double  Staircase 
Station  A 

Grade  3  -  station  5 
7  -  station  5 
11  -  station  5 


Scoring  of  the  Written  Responses 

2)    Score  3  pts*  If  the  student  accurately  determines  the  number  of 

blocks  In  the  staircase  to  be  16,     Score  2  pts*  If  the  student  laakes 
an  Incorrect  answer  of  13.     Score  1  pt.  If  the  student  makes  any 
other  Incorrect  response.     Score  0  If  the  student  makes  no  response, 

3-4)     Score  3  pts,  for  each  question  If  the  student  provides  the  correct 
answer  and  shows  work  which  Is  consistent  with  these  answers.  For 
question  3  this  answer  Is  36  and  for  question  4  this  answer  Is  100. 
Accurate  written  responses  may  substitute  for  the  show  of  work. 
Score  2  pts.  for  each  question  if  the  student  provides  the  correct 
answer  or  appropriate  work  but  not  both.    Score  1  pt.  each  for 
questions  3  and  4  if  the  student  provides  an  incorrect  response. 
Score  0  if  the  student  makes  no  response. 

5)    Score  2  pts.  if  the  student  accurately  determines  the  relationship 
between  the  height  of  the  staircase  and  number  of  blocks  needed  to 
build  it.    This  relationship  may  be  expressed  in  a  written  statement 
or  algebraically  (note  should  be  made  of  how  the  relationship  is 
specified).    Scoreable  responses  wuld  include  the  following:    n^  or 
n  X  n  f or  a  staircase  n  blocks  high;  h  or  h  x  b;  a»  b  x  h;  n-h^;  The 
number  of  blocks  needed  to  build  a  staircase  is  the  sqtiare  of  the 
height  of  the  staircase  or  is  the  height  of  the  staircase  times 
Itself.    Any  other  equivalent  algebraic  expressions  algebraically  or 
equivalent  statements  also  may  be  accepted  as  scoreable  responses. 
Score  1  pt.  if  the  student  provides  a  response  but  is  unable  to 
specify  the  relationship.     Score  0  if  the  student  provides  no 
response. 

Skills  Involved 

In  this  exercise  the  student  needs  to  determine  the  nature  of  a 
mathematical  relationship.     This  relationship  can  be  deduced  by  making 
generalizations  based  on  the  student's  findings. 


321 


Third  'Wj)e   vScore  Poirr  1 


1)    Look  at  the  'staircase'  of  blocks. 

Thikd  Saide    Score  PoVnt  2 


1)  Look  at  the  'staircase'  of  blocks- 

2)  The  staircase  is  4  blocks  high-    How  many  blocks,<#^  in 
the  staircase?  O 

Third  Grade    Score  Poirfr  3 


1)    Look  at  the  'staircase'  of  blocks- 


ERIC 


O  O  r* 


Seventh  (^rade    Score  Pom  1  ^o^cV 


lul  SJJoJJfc9'^^*A^^  "0**  "ANY  BLOCKS  ARE  IN 

THE  STAIRCASE.'  ^\/  J 

SejBm  'm^ade    Score  Point  2 

Seventh  Prade    vScore  Point  3 
The  staircase  is  ^  awjCHts  httu     u«u.  «... 

THE  STAIRCASE?  iVi?'     p^*^"'^"-     HoW  MANY  BLOCKS  ARE  IN 
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EuEVBfm  Grade    Score  Point  1 


< 


ELEVEhm  Grade    Score  Point  2 


™l  "^'Rc'Li?'^^  BgC^H.GH.     How  «ANy  BLOCKS  ARE  ,N 

Eleventh  ^^rade    Score  Point  3 
2)    The  staircase  is     blocks  high.    Ugw  many  blocks  are  in 

THE  STAIRCASE?  JJUj)^ 
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Thipd  Grade    Score  Poirfr  3 


How  MANY  BLOCKS  WOULD  BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  ,YOUR  ANSWER? 


5)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH?^/ 
How  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 'V^  . 


)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH*? 

How  DID  YOU   FIGURE  OUT  YOUR  ANSWER?  ^   
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Sevbtih  Frade    Score  Pom  3 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH?^,-  

How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  (    Z?  ) 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  ST^f-fi^E  6  BLOCKS  HIGH*? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  'ILOCKS  HIGH. 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 
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Eleventh  Prade    Score  ^oim  3 

How  MANY  BLOCKS  WOULD  BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 


How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  5  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  ^  y 


How  MANY  BLOCKS  WOULD  BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 
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Third  Grade    Scd^^  Point  2 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU   FLGURE  OUT  YOUR  ANSWER? 


3)     How  MANY  BLOCKS  WOULD  BE   IN  ATTAIRCASE  5  BLOCKS  HIGH? 
How  DID  YOU   FIGURE  OUT  YOUR  ANSWER?  ^^-^ 

 u  
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Seventth  ^rade    Score  Point  2 

F^:  srv^u'°^p^Lxr^?o^R  ^Nswi^f ' '''''' ''''' 


3)      How  MANY  BLOCKS  WOULD  BE    IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How   DID   YOU    FIGURE   OUT  YOUR  ANSWER? 


3)     How  MANY  BLOCKS  WOULD^E   IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU   FIGURE  OUT  YOUR  ANSWER?  , 


ERIC 
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Eleventh  Grade    Score  Point  2 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 

5 


3)     How  MANY  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS^  HIGH? 
How  DID  YOU   FIGURE   OUT  YOUR  ANSWER? 
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Third  Grade   Score  Point  1 


3) 


How  MANY 
How  DID 


BLOCKS  WOULD  BE  IN 
rOU  FIGURE  OUT  YOUR 


A  STAIRCASE 
ANSWER? 


6  BLOCKS  HIGH? 


gOU   FIGURE  OUT  YOUR  ANSWERf  f 


BS!!  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH'? 

How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  ^  ° 


SSU  BLOCKS  WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGH' 

How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  ""-"^^J* 


Seventh  Grade    Score  Point  1 


How  MANY  BLOCKS' wdULr-BE  IN  A  STAIRCASE  B  BLOCKS  HIGH?  ' 2) 
How  DID  YOU   FIG.URE   OUT.  YOUR  ANSWER?  •     .  ^ 


How  MANY  BLOCKS  wdLJnT^BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID   YOU   FIGURE  OUT  YOUR  ANSWER? 


How  MANY  BLOCKS  WOULD  BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 
How   DID   YOUy-FIGURE   OUT-YOL^R  ANSWER? 
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ELEvaiTH  Grade    Score  Point  1 


3)     How  MANY  BLOCKS  WOULD  BE  IN  A  STAIRCASE  6  BLOCKS  HIGH? 

How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  ' 


)     How  MANY  BLOCKS^WOULD  BE   IN  A  STAIRCASE  6  BLOCKS  HIGh2  i%- 
HOW  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  C\^~^ 

uhrPO  fO  /^/W  ^AhAs)  mtkAi  br-^  ^ 

3)     How  MANY  BLOCKS  WOUL^-^BE-^N  A  STAIRCASE  6  BLOCKS  HIGH? 
How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  ^  \  C^^^ 
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Third  Grade    vScore  Poimt  3 


4)     How  MANY   BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT   YOUR  ANSWER? 


Third  Grade    Score  Point  2 

4)     How  MANY   BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 

BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT  YOUR  ANSWER?   ^ 

ion  ,  nM  


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS   HIGH?     How  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 
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v^EVEWm  PRADE     vScORE  PoiNT  3 

H)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 


1)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 


0 


1)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 


ERIC 
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Eleventh  tirade    v^core  ^om  3 


B?0CKs'^IGH?"HnrnrS  T  ^°  STAIRCASE  10 

BLOCKS  HIGH.''     How  DID  YOU  FIGURE  OUT  YOUR  ANSWER?  / 

JOO — . — "26^  ^^p^<^  ^f^^a^^Qr)       (  ^ 


How  MANY  BLOCKS  WOULb  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     How  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 


Smm  ^RADE    Score  Point  2 


2LOcI!riii?M9"'gn2°nt°  ^0  BUILD  A  STAIRCASE  10 

BLOCKS   HIGH?     HoW  DID  YOU   FIGURE  OUT   YOUR  ANSWER? 


S^OcJf  ^TGH?"'HnrnTS  vS"  "''"^  '°  ^"^^D  A  STAIRCASE  10 
BLOCKS   HIGH.''     HOW  DID  YOU   FIGURE  OUT   YOUR  ANSWER*?  /^^^ 

  100  (O^ 


How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS   HIGH?     HoW  DID  YOU   FIGURE  OUT   YOUR  ANSWER? 


loo  A^^J^A 
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Eleventh  Grade    Score  Poii^  2 


4)     How  MANY  BLOCKS  WOULD  YOU   NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 


SlopK^ ii?u9''''Hn!J°i;'r°  ''^^^  ^°  ^"^"-D  A  SJA4RCASE  10 

BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT  YOUR /f^TrSitiJ? 

( An   " 


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS   HIGH?     Kow  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 

gWL   10'.  lO  V  6\b   
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Third  Grade    Score  Point  1 


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT   YOUR  ANSWER? 

HO 


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT   YOUR  ANSWER? 

AA  r 


*A)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS   HIGH?     HoW  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 


ERIC 
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Seventh  ^rade    Score  Point  1 


^)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 

BLOCKS  HIGH?     HoW  DID  YOU  FIGURE  OUT   YOUR  ANSWER?  ^ 


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     Hov:  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 


4)     How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS   HIGH?     HoW  DID  YOU  FIGURE  OUT  YOUR  ANSWER? 

jn  


3.iO 


Eleventh  Grade    Score  Poiw  1 


^)     How  MANY  BLOCKS  WOULD  YOU  NCcD  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 


How  MANY  BLOCKS  WOULD  YOU  NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU   FIGURE   OUT  YOUR  ANSWER? 


inxi^^  Ho  JiSL^JU-.  (J 


i\)     How  MANY  BLOCKS  WOULD  YOU   NEED  TO  BUILD  A  STAIRCASE  10 
BLOCKS  HIGH?     HoW  DID  YOU   FIGURE  OUT  YOUR  ANSWER? 
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SEVEmn  ^RADE    Score  Point  2 


5)    What  is  the  relationship  between  the  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it? 


5)    What  is  the  relationship  between  the  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it? 


5)    What  is  the  relationship  between  The  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it?  ^ ^^v^t 
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ELEVEhfTTH  Grade    Score  Point  2 


What  is  the  relationship  between  the  height  of  any  ( 
staircase  and  the  number  of  blocks  needed  to  build  n'^kzt  ^ 


What  is  the  relationship  between  the  heigkt  of  any 

staircase   AND  THE  NUMBER  OF  BLOCKS   NEEDED  TO  BUILD  IT? 

'^ttVC^  rvYA^  J,-nffo^  \4-  h  j  y^^iPji.^^ 


What  is  the  relationship  between  the  height  of  any 
staircase  and  the  numbe^of  blocks  needed  to  build  it? 
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Third  Grade    vScore  Point  I 


What  is  the  relationship  between  the  height  of  any 

STAIRCASE   AND  THE  NUMBER   OF   BLOCKS   NEEDED  TO  BUILD   IT^  ^ 


What  is  the  relationship  between  the  height  of  any 

STAIRCASE  A.'^n  THE  NUMBER   OF   BLOCKS   NEEDED  TO  BUILD  IT? 


What  is  the  relationship  between  the  height  of 
staircase  and  the  number  of  blocks  needed  to  build  it? 
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Se'^nto  "^rade    Score  Point  1 


5)    What  ic  the  relationship  between  the  height  of  any 
staircase  and  ihe  number  of  blocks  needed  to  build  it? 


'  G 


5)    What  is  the  relationship  between  the  heighI  of  any 

STAIRCASE  A.:D  THE   NUMBER  OF  BLOCKS   NEEDED  TO  BUILD   IT?  ^ 


5)    What  is  the  relationship  between  the  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it*^ 

DV^^^c^  ^e^'^^^  ^::3?>r-r-ac  orryyot  t.T^lj-  V  ' 
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Eleventh  Grade    Score  Po  i  ntt  1 


5)    What  is  the  relationship  between  the  height  of  any 

STAIRCASE  AND  THE  NUMBER  OF  BLOCKS   NEEDED  TO  BUILD   n'>         f  \\ 

5)    What  is  the  relationship  between  the  height  of  any 

staircase  and  the  number  of  blocks  needed  to  build  it? 


5)    What  is  the  relationship  between  the  height  of  any 
staircase  and  the  number  of  blocks  needed  to  build  it? 
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Comments  on  Double  Staircase  (Grades  3,  7,  and  11) 

In  this  exercise,  students  need  to  derive  a  generalized  formula  to 
determine  how  many  blocks  are  needed  to  build  a  staircase  of  any  height.  The 
students  are  intended  to  derive  this  formula  (expressed  either  as  a  numerical 
equation  or  a  statement)  as  they  progress  through  a  series  of  steps  presented 
in  the  problem. 

Students  were  provided  with  a  permanently  assembled  "staircase"  four 
blocks  high  and  enough  loose  blocks  to  build  the  staircase  up  to  one  6  blocks 
high,  but  not  enough  for  one  10  blocks  high.    The  "double  staircase"  was  built 
with  the  two  sides  at  right  angles  to  each  other  so  that,  from  the  front,  only 
the  top  block  of  the  single  column  of  4  blocks  shows.    Thus,  only  13  of  the  16 
blocks  were  visible  from  the  front. 

The  inadvertent  omission  of  a  line  for  the  response  to  the  first  question 
about  the  number  of  blocks  in  the  staircase  affected  the  data  for  that 
question,  particularly  at  grade  3  where  50  percent  of  the  students  did  not 
respond. 

The  exercise  was  too  difficult  for  third-grade  students.    Of  the  54  third 
graders  who  answered  the  first  question,  23  were  correct,  15  said  13  blocks, 
and  16  gave  some  other  incorrect  response.    Very  few  responded  correctly  to 
any  of  the  other  parts  of  the  exercise. 

At  grade  7,  of  the  100  students  who  answered  the  first  question,  52 
answered  it  correctly  but  23  apparently  ignored  the  hidden  three  blocks.  In 
comparison,  at  grade  11,  of  the  84  who  answered  the  question,  69  were  correct 
and  only  8  gave  the  response  of  13  blocks.    There  is  evidence  of  developmental 
change  from  seventh  to  eleventh  grade  in  the  sample  data.    For  example,  the 
maximum  score  on  the  6-block  question  was  achieved  by  69  percent  at  grade  11 
compared  to  25  percent  at  grade  7.    Fifty -nine  percent  of  eleventh  graders 
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compared  to  20  percent  of  seventh  graders  were  successful  in  making  the 
10-block  extrapolation.    Sixty-four  percent  at  grade  11  were  able  to  make  the 
generalization  for  any  height  compared  to  19  percent  at  grade  1. 

A  minor  change  in  v/ording  was  suggested  for  any  future  use;  namely,  to 
call  this  a  two-way  staircase  and  to  ask  in  each  question  how  many  blocks  are 
needed  to  build  a  two-way  staircase  like  this.    It  also  was  suggested  that  the 
wording  of  the  last  question  be  tightened  to  avoid  potential  confusion  about 
the  term  "any  staircase,"    This  exercise  is  recommended  for  future  use  in 
grades  7  and  11  with  minor  wording  changes,  but  not  for  grade  3, 
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GRADES  7,11 


STATION  5 


What  do  you  notice  about  the  tubes^  and 
how  far  the  liquid  goes  up  them? 


Here's  what  you  do: 

1)    Look  carefully  at  the  tubes  in  the  colored  water-  Do 

NOT  REMOVE   THEM  FROM  THE  WATER. 


What  did  you  find: 

2)    What  do  you  notice  about  the  tubes,  and  how  far  the 
liquid  goes  up  them? 


Now  LOOK  CAREFULLY  AT  TUBE  X  THAT  IS  ON  THE  TABLE-  Do  NOT  PUT  IT 
IN   THE  WATER. 


EXPLAIN! 


3)    how  far  would  you  expect  the  liquid  to  go  up  in  tube  x? 
Why  do  you  think  so? 


34iJ 


Activity  Identification:    Tubes  and  Capillarity 


Grade(s):  7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Science-Biology,  Chemistry 

Apparatus  required:    Beaker  containing  colored  water,  five  small  open-ended 
glass  tubes  labelled  A,  B,  C,  D  and  E,  of  equal  length  but  different  interior 
diameters,  and  one  open-ended  glass  tube  labelled  X  of  the  same  diameter  as 
one  of  the  five,  a  six-inch  ruler  (Administrator  should  make  sure  that  only 
five  tubes  are  placed  in  the  water.    The  sixth  tube  should  be  placed  along 
side  but  not  in  the  beaker  and  should  match  the  size  of  one  of  the  five  tubes 
in  the  solution.)    The  dish  should  be  filled  up  to  the  top  before  every 
administration.    Stock  liquid  should  be  kept  out  of  view  of  the  student. 

Administration:    All  materials  should  be  set  on  a  mat  of  white  paper.  Tubes 
A,  B,  C,  D,  and  E  should  be  lined  up  next  to  each  other  in  the  beaker  of 
colored  water.    Students  should  he  reminded  not  to  take  these  tubes  out  of  the 
water.    Tube  X  should  be  placed  alongside  but  not  in  the  beaker.    Tubes  should 
be  dried  off,  if  necessary  at  the  end  of  each  administration.    The  flm'd  level 
in  the  beaker  should  be  at  a  constant  level  for  all  administrations. 
Concluding  each  session,  all  tubes  should  be  cleaned  with  water  ^nd  then  with 
acetone. 

Servicing:    None  reqtn'red 


Tubes  and  Capillarity 
Station  B 

Grade  7  -  station  5 
11  -  station  5 

Scoring  of  the  Written  Responses 

2)  Score  3  pts,  if  the  student  makes  an  accurate  generalization  about 
the  relationship  between  the  diameter  of  the  tube  and  how  far  the 
liquid  travels  up  it*     Score  2  pts,  if  the  student  makes  an  accurate 
statement  about  how  far  the  liquid  will  travel  up  a  given  tube  or  set 
of  tubes,  without  making  a  generalization  across  all  tubes.     Score  1 
pt.  if  the  student  provides  an  erroneous  generalization,  an 
irrelevant  response  or  a  description  only.     Score  0  if  the  student 
makes  no  response, 

3)  Score  3  pts,  if  the  student  provides  a  plausible  hypothesis  about  how 
far  up  the  tube  the  liquid  will  travel  and  why.     Score  2  pts,  if  the 
student  provides  a  plausible  explanation  or  prediction  but  not  both. 
Score  1  pt,  if  the  student  provides  an  inaccurate  explanation  or 
prediction  or  both.     Score  0  if  the  student  provides  no  response. 

Skills  involved 

In  this  exercise  the  student  needs  to  note  the  relationship  between  two 
variables.     This  relationship  can  be  deduced  by  making  detailed  observations, 
by  noting  how  changes  in  the  independent  variable  affect  changes  in  the 
dependent  variable,  and  then,  by  deriving  a  generalization  for  an  "unknown." 


EKLC 
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SEVBfTH  f^RADE     ScORE  ^Olf^  3 


What  do  you  notice  about  the  tubl-.,  and  how  far  the       f  ^ 

LIQUID  GOES  UP  THEM?  \1  ^ 

fAe  Mxh^  R.///  ihe  uj/d^j^  ^(.  ^  fm^/^^  aA^^^^. 


What  do  you  notice  about  the  twees ,  and  how  far  the  x 

LIQUID  GOES  UP  THEM?^,^^^^^  ) 

■  The.  <4<vnnipr  -Hng-^'+?  .h,e  ,        Xvrftn^j^  r  ^  ^ — 

fh^  ('^o.u'tri  Qof^  :  

Cr      o  ^  


What  do  you  notice  about  the  tubes ^  and  how  far  the 

LIQUID  GOES  UP  THEM? 


352 


Eleventh  ^rade    Score  Point  3 
2)    What  do  you  notice  about  the  tubes,  and  how  far  the 

LIQUID  GOES  UP  THEM?  of  ^ur^r^\^ 


2)    What  do  you  notice  about  the  tubes,  and  how  far  the 
liquid  goes  up  them? 

rnrrouj^  '\r\  dlatyit-lcr  4Ul  ^f\Afr  IaqUa  oI  4l^^  -fjbej  a/o. . 


2)    What  do  you  notice  about  the  tubes,  and  how  far  the 

liquid  goes  up  them?  ^ 

 r  — ~ — I  =  
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I 


Seventh  Score  Point  2 


2)    What  do  you  notice  about  the  tubes,-  and  how  far  the 

LIQUID  GOES  UP  THEM?  f^x) 


J 


2)    What  do  you  not!ce  about  the  tubes ^  and  how  far  the 

liquid  goes  up  them?  , 


2)    What  do  you  notice  about  the  tubes ^  and  how  far  the 
liquid  goes  up  them? 
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Eleventh  Grade    Score  Point  2 
2)   wriat  do  you  notice  about  the  tubes,  and  how  far  the 

LIQUID  GOES  UP  THEM? 


2)    What  do  you  notice  about  the  tubes,  and  Hr>w  far  the 

LIQUID  GOES  UP  THEM?      .  ^AjJiy- 


SEVE^^rH  ^rade    Score  Point  1 


2)    What  do  you  notice  about  the  tubes,  and  kow  far  the 
liquid  goes  up  them? 


2)    Hkat  do  you  notice  about  the  tubes,  and  how  far  the 
LtstiD  goes  up  then? 


^'  riSlHf TUBES,-AND  HOW  FAR  THE 


ERIC 


356 


Eleventh  5rade    Score  Pom  2 

^\  u2;.s%Jes ^^^iMr"' 


2)    What  do  you  notice  about  the  tubes,  and  how  far  the 

LIQUID  GOES  UP  THEM? 


2) 


Do  Jot  put  it 
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v^EVEt^  f^RADE    Score  Point  3 


3)     Hoa  FAR  WOULD  YOU  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE  "^"y^Z^^  \ 

Why  DO  YOU  think  so?  f 


3)    how  far  would  you  expect  the  liquid  to  go  op  in  tube  x? 
Why  do  you  think  so? 


3)     How  FAR  would  you  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE 

Why  do  you  think  so? 


i 
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Eleve^hw  Prade    Score  Poirir  3 

5)     How  irAR  t*OUin  YOU  EXPECT  THE  LIQUID  TO  GO  UP  IN  TUBE  X? 
Whv  do  YOU  THINK  SO? 

IS   WQo:^    yrAe.  TH^  rCMt>a(jE^  TUR^ 
UiAm^    Z^v/EL/    ^OS^    ^^^^   'l'H£  TUScX 


3)     How  FAR  WOULD  YOU  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE  X? 
Why  DO  YCU  THINK  SO? 


C 


3)     How  FAR  WOULD  YOU  FXPECT  THE  LIQUID  TO  GO  UP  IN  TUBE  X? 
WHY  DO  YOU  THINK  SO? 

Ha,  V'O^xfid  lAi^bcy  voqjB  Poop  bgfgjsg-  M '2  
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Seventh  '^rade    Score  Point  2 


3)     How  FAR  WOULD  YOU  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE  X? 

Why  DO  YOU  think  so? 


3)    How  far  would  you  expect  the  liquid  to  go  up  in  tube  X'^C  "2-^ 
Why  do  you  think  so?   y 

^  ^^^^^^^^^^  ^^^^ //^■^aOi^  X 


Pvy^i  /yOKl 


3)    How  far  would  you  expect  the  liquid  to  go  up  in  tube  X? 
Why  do  you  think  so? 
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Eleventh  Grade    Sccre  Point  2 


3)     How  FAR  WOULD  YOU  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE  X? 

Why  do  you  think  so? 


3)    how  far  would  you  expect  the  liquid  to  go  up  in  tube  x"? 
Why  do  you  think  so? 


wh?  Io\ZVhZ\W'''     '''''' ^° '''' 
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Seventh  Grade    Score  Point  1  VcsjA'  " 


3)    how  far  would  you  expect  the  liquid  to  go  up  in  tube  x? 
Why  do  you  think  so?  . 


T 


3)     How  FAR  WOULD  YOU  EXPECT  THE  LIQUID  TO  GO  UP   IN  TUBE  X? 
WHY  DO  YOU  THINK  SO? 


3)    how  far  would  you  expect  the  liquid  to  go  up  in  tube  x?/^x 
Why  do  you  think  so?  (  ^\ 
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Eleventh  Grade    Score  Point  1 


3)    how  far  would  you  expect  the  liquid  tj  go  up  in  tube  x? 
Why  do  you  think  so? 

 —  1  j  f  T  1_  .  


3)    how  far  would  you  expect  the  liquid  to  go  up  in  tube  x? 
Why  do  you  think  so? 


3)    how  far  would  you  expect  the  liquid  to  go  up      (;:?;•  '  ? 

Why  do  you  think  so?  ^ 
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Comments  on  Tubes  and  Capillarity  (Grades  7  and  11; 

In  this  exercise,  students  were  asked  to  make  observations  ^ibout  the 
height  of  colored  water  in  5  tubes.    Each  of  the  tubes  had  a.  Afferent 
interior  diameter.    The  students  were  expected  to  infer  the  rj^iationship 
between  water  height  and  interior  diameter.    Finally,  students  had  to  apply 
this  relationship  to  predict  how  high  water  v;ould  rise  in  a  -./jbe  with  an 
interior  diameter  that  was  the  same  as  one  of  the  original  five  tubes. 

Students  at  both  grade  levels  seemed  to  understand  ihis  cask  and  the 
results  indicated  improved  performance  from  grade  7  to  iU    For  the  si^cond 
part  of  the  exercise,  accurate  observations  were  made  about        hei^irc  of  the 
water  in  the  tubes  by  50  percent  of  the  seventh  grauers  and  oy  /3  ;.ercent  of 
the  eleventh  graders.    Statements  about  the  relationship  between  the  height 
and  interior  diameter  were  made  by  22  percent  of  the  seventh  graders  and  39 
percent  of  the  eleventh  graders. 

For  the  third  part  of  the  exercise,  accurate  i?ypo:heses  about  how  high 
the  water  would  rise  in  tube  X  r,r:d  the  reasons  why  were  provided  by  29  percent 
of  the  seventh  graders  and  by  33  percent  of  the  eleventh  graders.  A 
hypothesis  without  a  reason  was  mtde  by  an  additional  21  percent  of  the 
seventh  graders  and  41  percent  of  the  eleventh  graders. 

The  adrnioistrators  reported  that  the  students  had  trouble  with  the 
apparatus.    The  liquid  wa3  difficult  to  see  which  mate  the  height  of  the 
liquid  in  the  tubes  very  difficult  to  determine.    If  students  removed  the 
tubes  from  the  liquic,  the  exercise  was  usually  confounded  because  the  tubes 
with  fina  inner  diameters  can  become  "air  bound."    If  the  tubes  are  moved 
within  the  liquid  ,  tho  levels  can  change  in  the  tubes.    It  was  the  consensus 
of  the  advisory  panel  that  the  exercise  needs  a  liquid  that  is  easier  to  see 
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and  instructions  that  are  more  explicit.    The  tubes  should  be  fixed  for  easier 
observation  and  measurement.    The  students  should  not  be  able  to  move  or 
remove  the  tubes. 

The  exercise  did  sSiOW  that  many  seventh  and  eleventh  graders  in  the 
sample  could  observe  and  report  a  relationship  between  two  variables.  The 
equipment  is  small,  but  tricky  to  set  up  and  difficult  to  maintain.  This 
exercise  may  be  appropriate  for  a  future  national  assessment  if  it  is  revised 
and  the  equipment  is  changed.    The  panel  recommended  that  it  not  be  used  as 
pilot  tested. 
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GRADE  11 


STATION  ^ 

Ihe  bSJes!"'"''  ''"'"-'^  Use  the  circuit  to  test 

SoJ"!I'?HE*'S?lNrf'/Nr''  tSSIS'"'  ^"'^^^  "O*'''  THE  LETTER  OF  THE 

Which  box  contains: 

  1-   A  PIECE  OF  hood? 

_    2.   A  VARIABLE  CONDUCTOR?     (SOMETHING  THAT  CONTROLS  THE 

RATE  OF  CURRENT  THROUGH  THE 

circuit) 

_    3.   A  RESJSTOR?  (SOMETHING  THAT  LIMITS  THE  CURRENT  THAT 

CAN  PASS  THROUGH  THE  CIRCUIT) 

  ^'   A  BATTERY? 

  5.   A  PIECE  OF  COPPER  WIRE? 

_     6.  A  DIODE?  (SOMETHING  THAT  ONLY  LETS  THE  ELECTRICITY 

PASS  THROUGH  THE  CIRCUIT   IN  ONE  DIRECTION) 
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Activity  Identification:  Conductivity 
Grade(s):  11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Sci ence-Physi cs 

Apparatus  required:    Five  sealed  black  boxes  labelled  A-E  containing  the 
tol lowing  materials:    A  =  a  piece  of  copper  wire,  B  =  a  resistor,  C  =  a  piece 
of  wood,  D  =  a  diode,  E  =  a  micro  relay;  one  circuit,  set  up  with  three 
1.5-voU  batteries  in  holder,  an  ammeter,  and  socket  for  testing  the  boxes; 
three  spare  batteries.    Apparatus  for  circuit  should  be  set  up  as  shown  in  the 
diagram  below. 

Administration:    The  circuit  should  be  set  up  as  specified  in  the  diagram 
Within  the  Conductivity  box  with  boxes  A-E  placed  alongside  it.    No  box  should 
be  left  in  contacts  at  the  end  of  each  administration.    Circuits  should  be 
checked  after  every  administration  to  see  if  they  are  still  connected. 

Servicing:    None  required 


Batteries 
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Conductivity 
Station  B 

Grade  li  -  station  4 


Scoring  of  the  Written  Responses 

1-6)    Score  1  point  for  every  correct  answer.    Scoreable  answers  should 
include  the  following  sequence  of  responses: 

1.  C 

2.  £ 

3.  B 

4.  — 

5.  A 

6.  D 


Note:  The  student  should  be  scored  for  having  left  4  blank  but  only 
when  she  or  he  has  filled  in  all  the  other  responses. 


Skills  involved 


In  this  exercise  the  student  needs  tc  determine  a  set  of  answers  based  on 
her  or  his  available  content  infonaation  and  information  presented  within  the 
context  of  the  problem. 
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El£venth  Grade  Score  Pom  6 

Which  box  contains: 

^   !•  a  piece  of  wood? 

^   2-  a  variable  conductor?  (something  that  controls  the 

RATE  OF  CURRENT  THROUGH  THF 

circuit) 

A.     3.   A  RESISTOR?  (something  THAT  LIMITS  THE  CURRENT  THAT 

CAN  PASS  THROUGH  THE  CIRCUIT) 

  ^-   A  BATTERY? 

^     5.   A  PIECE  OF  COPPER  WIRE? 

JJL     6.   A  DIODE?  (SOMETHING  THAT  ONLY  LETS  THE  ELECTRICITY 

PASS  THROUGH  THE  CIRCUIT   IN  ONE  DIRECTION) 


ERIC 
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Eleventh  Grade    Score  Pom  ^ 


Which  box  contains: 

£    !•  a  piece  of  wood? 


2-  a  variable  conductor?    (something  that  controls  the 

rate  of  current  through  the 

circuit) 

3-  A   RESISTOR?   (something  THAT  LIMITS  THE  CURRENT  THAT 

CAN   PASS  THROUGH  THE  CIRCUIT) 

  -a  BATTERY? 

A     5-    A  PIECE   OF   COPPER  WIRE? 

ii     6.   A  DIODE?   (something  THAT  ONLY  LETS  TilE  ELECTRICITY 

PASS  THROUGH  THE  CIRCUIT   IN  ONE  DIRECTION) 
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ELEVEhnrH  f^RADE     v^CORE  PQINT  3 


Which  box  contains : 

1.    A  PrtCE  OF  WOOD? 

2^   2.  a  variable  conductor?    (something  that  controls  the 

rate  of  current  through  the 
.  circuit) 

^    3.   A   RESISTOR?   (something   THAT  LIMITS   THE  CURRENT  THAT 

CAN  PASS  THROUGH   THE  CIRCUIT) 

A  BATTERY?  ^ 

A   PIECE  OF  COPPER  WIRE? 

6.   A   DIODE?   (something  THAT  ONLY  LETS  THE  ELECTRICITY 

PASS  THROUGH   THE  CIRCUIT    IN  ONE  DIRECTION) 
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Eleventth  ''^^''^    ^'CORE  Pom  2 


Which  box  contains: 

Qy   1.    A  PIECE  OF  WOOD? 

A  VARIABLE  CONDUCTOR?     (SOMETHING   THAT  CONTROLS  THE 

RATE   OF  CUKRENT  THROUGH  THE 

CI rcuit) 

t^-<i—     5.    A    RESISTOR?    (something   THAT   LIMITS   THE  CURRENT  THAT 

CAN  PASS  THROUGH  THE  CIRCUIT) 

^'    A  BATTERY? 

yi:!!^  ^.    A   PIECE   OF   COPPER  WIRE? 

£    6.   A   DIODE?   (something  THAT  ONLY   LETS  THE  ELECTRICITY 

PASS  THROUGH   THE  CIRCUIT   IN  ONE  DIRECTION) 


<=^  -  \qO  L^<^ 

B  ••  ''GP^  moot  [yx^ti-.  -Por-Ks  ,  Cor-hcf!c«t 
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Eleventh  Grade    Score  Point  1 


Which  bo;<  contains: 

1'  a  piece  of  wood? 

jE     2.    A  VARIABLE  CONDUCTOR?     (SOMETHING  THAT  CONTROLS  THE 

RATE   OF   CURRENT  THROUGH  THE 

CI rcuit) 

3.   A   RESISTOR?   (something  THAT  LIMITS   THE  CURRENT  THAT 

CAN   PASS  THROUGH   THE  CIRCUIT) 


A  BATTERY? 

A  PIECE   OF   COPPER  WIRE? 


6.   A  DIODE?   (something  THAT   ONLY   LETS  THE  ELECTRICITY 

PASS   THROUGH   THE   CIRCUIT    IN   ONE  DIRECTION) 


ERIC 
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Comments  on  Conduct  1 v1 ty  (Grade  11) 

In  this  exercise,  students  were  asked  to  determine  the  identity  of  five 
unknown  materials.    Students  had  to  conduct  tests  with  an  electric  circuit  and 
infer  which  of  the  unknowns  were  a  piece  of  wood,  a  variable  conductor,  a 
resistor,  a  battery,  a  piece  of  copper  wire,  and  a  diode. 

The  correct  identity  for  all  unknowns  was  selected  by  31  percent  of  the 
students.  Tho  most  conflnon  errors  were  made  between  the  wood  and  the  diode, 
the  wire  and  the  battery,  and  the  wood  and  the  resistor.  The  advisory  panel 
hypothesized  that  the  wood  and  diode  error  might  have  resulted  from  students 
testing  only  some  of  the  unknowns  and  hence,  reaching  erroneous  conclusions. 
The  wire  and  battery  error  might  arise  because  students  may  not  have  knowledge 
of  the  workings  of  batteries  and  wires. 

It  was  the  consensus  of  the  advisory  panel  that  the  electrical  apparatus 
was  too  content  or  experience  oriented.    This  view  was  supported  by  the  gender 
differences  in  the  data.    Forty-six  percent  of  the  males  compared  to 
20  percent  of  the  females  in  the  sample  correctly  identified  all  the  unknown 
materials.    It  was  suggested  that  one  common  item,  such  as  heavy  household 
wire  with  the  ends  exposed,  be  provided  to  illustrate  what  happens  on  the 
meter  when  the  material  tested  carries  electricity.    The  panel  felt  that  if 
more  explanation  of  the  apparatus  is  included,  the  exercise  could  be 
administered  to  seventh  graders  as  well  as  to  eleventh  graders. 

Tv:^  administrators  reported  that  students  liked  "experminenting"  with  the 
appare  is.  Also,  the  results  showed  that  some  students  were  able  to  solve  the 
problem.  The  equipment  is  small,  and  with  proper  instruction,  it  is  very  easy 
to  set  up  and  maintain.  If  it  is  revised  as  suggested,  this  exercise  would  be 
appropriate  for  use  with  eleventh  and  poss'ibly  seventh  graders  in  a  future 
nat i Dnal  assessment . 


GRADES  3,7,11 

STATION  1 

You   ARE   GOING   TO   PLAY   THE   GUMBALL   GaME   WITH   THE  COMPUTER- 

The  computer  will  tell  you  what  to  do  ;nd  you  will  put  all 
your  answers  into  the  computer* 
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SelHdnldstered  Station  M^.lvlty  3,7,11 


Does  the  jar  lja.Ye  aore  red  gdallc  or  aore  green  gwballs?  Pick  soie 
gonballs. 

Press  the  mW  of  graballs  yoa  want  on  the  \efmtL 

(for  grade  3) 

!ou  can  pick  any  nnber  fron  I  through  10. 

(for  grades  U  11) 

You  can  pick  any  nuaber  froa  1  through  100. 

(After  the  student  has  selected  a  number)  You  got  (sope  number)  red 
guaballs  and  (some  number)  green  guaballs. 

Note;  Compute:  screen  will  then  show  how  a  sample  record  of  the  student's 
responses  will  look  (see  example  below) 

Draw  Red  te 

1  6  i 

This  is  a  record  of  your  pick, 

The  coaputer  will  give  you  six  turns. 
Press  R  wheu  you  are  ready  to  play. 

(After  the  student  has  pressed  R) 

Pick  ^ome  guaballs. 

Hov  R£ny  do  you  want? 

Press  the  nuuber  on  the  keyboard. 

(After  the  student  has  made  a  response)  fou  got  (si  ,i  nmh-i:)  red 
gunballs  and  (soiKi  nmber)  green  graballs. 

No':e:  A  record  of  the  student's  picks  will  be  kept  in  the  right  hand  corner 
of  the  screen.  This  record  will  always  be  available  for  the  ^.udent  to  aee. 

The  program  will  proceed  in  the  manner  above  for  6  d;,'VS.  .i^ter  the 
sixth  draw  the  student  will  be  given  the  promptly  to  determine  whether  the  lar 
has  more  red  gumballs  or  green  gumballs  and  what  this  ratio  is. 


Does  the  jar  have  more  red  guaballs  or  green  gunballs?  Fress  R  it  there 
are  more  red  guaballs.  Press  G  If  there  are  aore  green  gcBhalls. 

(After  the  student  has  made  a  response)  You  answered  that  the  jar  has  more 
(red/green)  guaballs. 

Fill  iE  the  blanks  in  this  sentence  by  pressing  the  nuabers  on  the 
keyboard  which  sill  make  the  sentence  read  shat  you  think  the  ratio  la. 

(for  grade  3) 

For  every  tw  red  guaballs  in  the  jar  there  are  (some  number)  green 
gumballs. 

(for  grades  7  &  11) 

The  ratio  of  red  guaballs  to  green  guaballs  is  (some  number)  red  to  (some 
number)  green. 

(Note:  The  ratio  for  grade  3  will  be  2  re^  gumballs  to  1  green  gumball.  The 
ratio  for  grades  7  &  11  will  be  3  red  gunballs  to  2  green  gumballs.) 

Good  gaae.  Thaoks  for  playing  the  Gnball  Gaae. 


Comments  on  the  Gumball  Game  (Grades  3,  7,  11) 

This  is  a  computer-administered  task  in  which  the  students  are  expected 
to  usfe  the  -esults  from  a  series  of  draws  to  determine  whether  there  are  more 
red  or  green  gumballs  in  the  jar  and  the  ratio  of  red  to  green.  The  student 
designates  each  time  the  number  of  gumballs  to  be  drawn,  the  computer  makes 
random  picks  and  reports  the  number  of  red  and  of  green  obtained.    For  grade 
3,  the  computer  was  programmed  to  pick  up  to  10  from  a  jar  with  a  2:1  ratio  of 
reds  to  greens.    For  grades  7  and  11,  the  program  allowed  for  picks  up  to  100 
per  draw  from  a  jar  with  a  3:2  ratio  of  reds  to  greens. 

As  with  the  other  computer-administered  tasks,  a  significant    portion  of 
the  data  was  lost.    The  problem  may  have  been  caused  by  differences  between 
computers  or  lapses  between  administrations.    It  was  not  due  to  the  program. 
All  the  grade  7  and  11  programs  were  copied  from  the  same  master  disk. 
Administrators  reported,  in  most  cases,  that  the  program  ran  and  all  students 
did  the  tasks. 

The  number  of  usable  cases  for  grade  3  are  only  41;  for  grade  7,  there 
are  92;  for  grade  11,  59.    In  comparison,  the  number  of  students  who  were 
administered  the  Gumball  Game  was  110  at  grade  3,  120  at  grade  7,  and  101  at 
grade  11. 

Despite  the  small  number  of  responses,  a  5-part  alphabetic  classification 
was  created  for  tracking  the  students*  strategies  in  drawing  gumballs.  It 
appears  that  the  task  was  appropriate  even  at  the  youngest  grade  level.  Of 
the  third  graders  for  whom  there  is  data,  most  varied  their  requests  between 
high  and  low  although  none  requested  the  maximum  number  on  all  drawings.  A 
larger  percent  was  able  to  complete  this  task  than  the  Circle  Game.    Only  5 
students  did  not  answer  the  first  question  and  80  percent  responded  correctly 
that  there  were  more  red  gumballs.    On  the  other  hand,  the  third  or^iders  did 
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not  understand  the  question  about  the  ratio  as  it  was  phrased  without  using 
the  term  and  none  answered  this  question  correctly.      learly,  the  second 
question  as  worded  is  not  appropriate  for  third  grac.--. 

With  respect  to  the  ratio  question  for  grades  7  and  11,  when  students 
drew  low  numbers  most  of  the  time,  the  record  did  not  imply  the  expected  3:2 
ratio.    Because  the  computer  had  been  programmed  to  complete  and  print  out  the 
average  number  of  reds  and  greens  obtained,  it  was  decided  to  use  the  record 
and  to  accept  as  correct  not  only  3:2,  but  any  ratio  close  to  the  ratio  of 
the  averages  actually  obtained^    When  the  student  gave  as  the  ratio  the  sums 
of  the  numbers  of  reds  and  greens  obtained  in  all  the  tries,  the  responses 
were  classified  in  a  separate  score  level. 

Although  the  idea  for  this  task  is  good  and  students  can  understand  how 
to  do  the  task,  the  program  needs  reworking.    The  advisory  panel  suggested 
that  the  program  should  be  more  directive  at  the  beginning  and  that  students 
should  be  told  that  they  are  looking  for  a  ratio.    The  program  also  needs  a 
definition  of  the  sample  space  (i.e.  how  many  gumballs  in  the  jar)  and 
information  on  whether  the  sampling  is  with  replacement  after  each  drawing. 
For  grade  3,  either  the  program  should  stop  at  the  "more  reds  than  greens" 
stage  or  try  asking  the  ratio  question  in  the  form  of  a  predi'tion:    "If  you 
now  picked  9  gumballs,  how  many  reds  would  you  expect  to  get?"    For  grades  7 
and  11,  rewording  was  suggested  to  say,  "the  ratio  of  red  gumballs  ..o  green 

gumballs  probably  was    red  to    green." 

The  revised  programs  would  require  pilot  testing  at  all  three  grades 
before  operational  use. 
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GRADE  3 


STATION  H 

you  have  been  given  some  bubble  wands. 

The  wands  make  different  kinds  of  bubbles  in  different  ways* 
Here's  what  you  do: 

1)  Take  each  wand,  and  blow  through  it  to  make  bubbles. 
What  did  you  find: 

2)  Write  down  what  you  find  in  the  table  below* 


Type  of 


Number  of 


Size  of 


Shape  of 


SMALL  SQUARE 

SMALL  CIRCLE 

LARGE  SQUARE 

LARGE  CIRCLE 

Explain  what  you  found: 

3)    Look  back  at  the  notes  in  your  table* 

^)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  wand  gets  LARGER? 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  shape  of  the  WAND  CHANGES? 


ERIC 
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GRADES  7,n 


STATION  4 


You  HAVE  BEEN  GIVEN  SOME  BUBBLE  WANDS-  ThE  WANDS  MAKE  DIFFERENT 
KINDS   OF  BUBBLES    IN   DIFFERENT  WAYS. 


HeRE*S  what  you  DO: 

1)    Take  each  wand  and  blow  through  it  to  make  bubbles. 


What  did  you  find: 

2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION   ABOUT   HOW  MANY   RURRLES  WERE 
MADE   BY   EACH   WAND,    HOW  BIG   THE   BUBBLES   WERE,    AND  THE 
SHAPES   OF   THE  BUBBLES. 


Explain  WHAT  you  found: 

3)    Look  back  at  your  table. 

^)    What  happens  to  the  number  and  size  of  ^he  bubbles  as 

THE  wand   gets  LARGER? 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


Activity  Identification:  Bubbles 


Grade(s):  3,7,11 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Area:    Mathematics-Geometric  Relationships 

Apparatus  required:    Small  and  large  bubble  wands  of  different  shapes  (square 
circular,  and  triangular);  paper  towels,  1  small  bottle  of  bubble  mixture 
(containing  dishwashing  liquid  and  water),  paper  and  pencil.    For  grade  3 
students  only  the  square  and  circular  wands  will  be  used. 

Administration:    Bubble  wands  should  be  placed  on  a  wad  of  paper  towels  before 
the  onset  of  each  administration.    Administrators  should  make  sure  that  the 
students  blow  the  bubbles  away  from  other  students  and  their  own  papers. 
Bubble  mix  should  be  filled  half-way  before  the  onset  of  each  administration. 
Stock  liquid  should  be  kept  out  of  view  of  the  student. 
Servicing:    None  required 


Bubbles 
Station  A 

Grade  3  -  station  4 
7  -  station  4 
11  -  station  4 


Scoring  of  the  Written  Responses 
(for  grade  3) 

2)  Score  2  pts.  If  the  student  completes  the  table  of  findings.  Score  1 
pt.  If  the  student  provides  an  incomplete  table  of  findings.  Score  0 
if  the  student  makes  no  response. 

(for  grades  7  &  11) 

2)    Score  3  pts.  if  the  student  makes  a  complete  table  of  her  or  his 
findings.     (Note:     This  table  should  be  comparable  to  that  already 
provided  for  the  grade  3  students).     Score  2  pts.  if  the  student 
provides  an  Incomplete  table  of  her  or  his  findings.     Score  1  pt.  if 
information  is  provided  in  a  non-tabular  form.      Score  0  if  the 
student  makes  no  response. 

(for  grades  3,  7  &  11) 

4)  Score  4  pts.  if  the  student  specifies  the  relationship  between  size 
of  the  bubble  wand  and  the  number  and  size  of  the  bubbles  made  that 
is  consistent  with  the  table.     Score  3  pts.  if  the  student  specifies 
the  relationship  between  the  number  and  size  of  the  bubbles  made  that 
is  inconsistent  with  the  table.     Score  2  pts.  if  the  student  makas 
specific  statements  about  how  the  size  of  the  wand  Influences  the 
number  or  size  of  the  bubbles  that  is  consistent  with  the  table. 
Score  1  pt.  if  the  student  provides  an  irrelevant  or  non-specific 
statement.     Score  0  if  the  studerc  makes  no  response. 

(for  grades  7  &  11) 

5)  Score  5  pts,  if  the  r.,tudent  specifies  the  relationship  between  the 
shape  of  the  bubble  wand  and  the  number  ar-i  size  of  the  bubbles  made 
that  is  consistent  with  the  t-.jle.     Score  4  pts.  if  the  student 
specifies  the  relationship  between  the  shape  of  the  bubbles  wand  and 
the  number  and  size  of  the  bubbles  made  which  is  inconsistent  with 
the  table.     Score  3  pts.  if  the  student  makes  a  specific  statement 
about  how  the  shape  of  the  wand  influences  the  number  or  size  of  the 
bubbles  th,at  is  consistent  with  the  table.     Score  2  pts.  if  the 
student  makes  a  specific  stateraenr.  that  is  inconsistent  with  the 
Information  in  the  table.      Score  1  pt.  if  the  student  provides  an 
irrelavant  or  non-specific  statement.     Score  0  if  the  student  makes 
no  response. 

Note:  Specific  statements  are  presujied  to  oe  correct  statements. 
Skills  involved 

In  this  exercise  students  must  record  (and  for  the  grade  7  and  1 1 
students,  organize)  a  set  of  findings.     Based  on  these  findings  the  students 
must  then  make  a  generalization  about  how  changes  in  the  independent  .-ariable 
bring  about  changes  in  the  dependent  ^rariable.     These  generalizations  should 
be  based  on  comparisons  and  contrasts  of  the  findings. 
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Third  Grade    Score  Point  2 
2)    Write  down  what  you  find  in  the  table  below. 


n^^''^  °r,                  WuMBER.oF             Size  of              Shapf  hp 
BUB.BLE  Wand                Rubb.  p.               n!,tl,  °:           ■  ^Sf^!!.  °^ 

SMALL  SQUARE 

1 

\ 

Circle 

SMALL  CIRCLE 

LARGE  SQUARE 

LARGE  CIRCLE 

2)    Write  down  what  you  find  in  the  table  below. 

„Type  of                  ^Jumber  of             Size  of              Shape  of 
Bubble  Wand               Bubbles                Riirri  ps  Uuuv, 

SMALL  SQUARE 

! 

SMALL  CIRCLE 

1 

LARGE  SQUARE 

1 

in /a 

LARGE  CIRCLE 

1 

 rzr  — 

2)    Write  down  what  you  find  in  the  table  below- 


Type  of  Number  of  ,  Size  of  Shape  of 
Bubble  Wand   Bubbles   Bubbles  Bubbles 


SMALL  SQUARE 

I 

«_l  U         i_  ^ 

Circle 

SMALL  CIRCLE 

Cfrr/e 

LARGE  SQUARE 

Jol^  L 

c  1  rc'.'s. 

LARGE  CIRCLE 

-JJ.  
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SB/Ef^  r-RADE    Score  '^oint  3 


2) 


Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE' 
MADE   BY   EACH  WAND^    HOW  BIG   THE   BUBBLES   WERE^   AND  THE 
SHAPES   OF   THE  BUBBLES. 


Holy  yieny 

//ou/  /?'> 

1  sy(?/-€J- 

-5  0 

Shtih 

}A 

/ 

3 

■to 

SA  1 

2) 


Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE  INCLUDE  INFORMATION  ABOUT  HOW  MANY  BUBBI  FS  WERE 
MADE   BY   EACH  WAND,    HOW  BIG   THE   BUBBLES   WEReTaND  THE 


3^   Uf^  /^oM 


2) 


I 


Write  down  what  /ou  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.-    In  your 
table  include  information  about  how  many  bubbles  were 
made  by  each  wand,  how  big  the  bubbles  were,  and  the 
shapes  of  the  bubbles.  / 


ERIC 


\ 
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El_EVEffrH  -iRADE     FCORE  ^OINT  5 

2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE   include   INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY   EACH  WAND,   HOW  BIG  THE  BUBBLES  WERE,   AND  THE 
SHAPES   OF   THE  BUBBLES. 


Write  dow^  what  you  find  out  about  how  the  wands  make 

BUBBLES-      ^JT  THIS   INFORMATION    IN  A  TABLE.      In  YOUR 
TABLE    INCLUDE  -  INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY   EACH  WAND^    HOW  BIG   THE   BUBBLES  WERE^   AND  THE 


SHAPES   OF   THE  BUBBLES- 


2) 


1 

3, 

0,  ' 

3 


d 


Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY   EACH  WAND,   HOW  BIG  THE  BUBBLES  WERE,   AND  THE 
SHAPES   OF   THE  BUBBLES. 


i  nnif  nnrii  ftl  vmiK  iimtr'    '  '^if^fj  Vr\y}^\-\ 


5^EVENTH  ^RADE     ScORE  PoiNT  2 


2) 


Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLESo    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE   BY   EACH   WAND^    HOW  BIG   THE   BUBBLES  WEREy   AND  THE 
SHAPES  OF   THE  BUBBLES* 


ERIC 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT   HOW  MANY  BUBBLES  WERE 
MADE   BY   EACH  WAND^    HOW  BIG   THE   BUBBLES  WERE^   AND  THE 
SHAPES   OF   THE  BUBBLES* 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE  INCLUDE  INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE   BY   EACH   WAND^   HOW  BIG   THE   BUjBBl^ES  WERE^   AND  THE 
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ELEVEfiTH  Grade    Score  Point  2 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY   EACH   WANDy    HOW  BIG   THE   BUBBLES   WERE>   AND  THE 
SHAPES   OF   THE  BUBBLES. 


1^  ol- 

\ 

\ 

\ 

\ 
I 

2) 


8^8^%?°" Mt^^'IulfcMJ^^^  WANDS  MAKE 

BUBBLES.      Put   this    information    in  a   table.      In  YOUR 
TABLE    INCLUDE    INFORMATION   ABOUT  MWMANY  BUBBL  ES  WFRF 
MADE  BY   EACH   WAND.    HOW  BIG   THE   BABBLES  WEReTanS  THE 
SHAPES   OF   THE  BUBBLES.  — ^ 


I 

/ 


ERIC 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES*    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY   EACH   WAND^    HOW  BIG   THE   BUBBLES  WERE^   AND  THE 
SHAPES   OF   THE  BUBBLES- 


ur    I  r 


'  AJOr^ 

j 

T 


 1 


Third  'hrade    Score  Point  I 


2)    Write  down  what  you  find  in  the  tabl  -^w- 

Type  of                  Number  of              Sizf  nr  quadit 
BuBBi.5  Wand                Bubb,  f.                                        Sh_a_p_e  of 

SMALL  SQUARE 

SHALL  CIRCLE 

LARGE  SQUARE 

LARGE  CIRCLE 

v/ 

V  1 

2)    Write  down  what  you  find  in  the  table  below- 


Type  of 
Bubble  Wand 


small  square 


SMALL  CIRCLE 


LARGE  SQUARE 


LARGE  CIRCLE 


Number  of 

BUBBI  FS 


3 


Size  of 
.Mbbles 


Shape  of 
Bubbles 


2)    Write  down  what  you  find  in  the  table  below. 


Type  of 


Number  of 


Size  of 


Shape  of 


SMALL  SQUARE 

ij  u  u  i-»  L-  q  o 

SMALL  CIRCLE 

LARGE  SQUARE 

/ 

LARGE  CIRCLE 

Seventh  ^^rade    Score  ^oint  1 


2)    Write  down  what        ^^^^  ^^"^  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION   ABOUT   HOW  MANY   BUBBLES  WERE 
MADE   BY    EACH   WANH.    HOW   B I '3   THE   BUBBLES   WERE,    AND  THE 
SHAPES    OF   THE  sUt^^^ES- 

^ts  fcubUes  obooA-      bobbles  -l'^^ 

roY  ony  ^^^^^  "   .  .     ,  . 

A  .         ujer6 a\ooa+  \0  bobble 
f  no  \cubW^.  l^K^cTioH  c.rc\^ 


c 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION   ABOUT   HOW  MANY   RIlRRi  WERE 
MADE   BY   EACH   WAND,    HOW   BIG   THE   BUBBLES   WERE,    AND  THE 
SHAPE?   OF   THE   BUBBLES-  '  ^ 

oat  4ch(r^;^iic^ro^ncL 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION   ABOUT   HOW  MANY   BUBBLES  WERE 
MADE   BY   EACH   WAND,    HOW   BIG   THE   BUBBLES   WERE,    AND  THE 
SHAPES    OF   THE  BUBBLES. 

OhiL  mtCX^  s09^  LjjhkJlS   %  COT)^^  CO- 
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ELEVEhm  Grade    Score  Point  1  c . .  \  ^. 

2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES'    Put  this  information  in  a  table.    In  your 

TABLE    include    INFORMATION  ABOUT  HOW  MANY  BlIRSI.gS  WERE 
MADE  BY    EACH   WAND^    HOW  BIG   THE   BUBBLES   WERE^   AND  THE 
SHAPES   OF   THE  BUBBLES- 

line  Smaller  -  wanis  r/^vSJe,  rrwe.  hJt  smaller 
bub(o\&5  lOHiK.  £dry\o  Ou4-  in.  diffen^nV  kit  bunl^ie^ 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES..    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION  ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY    EACH   WAND^    HOW  BIG   TI^E   BUBBLES   WERE^    AND  THE 
SHAPES   OF   THE  BUBBLES. 

0  .  P)MJL  AilV^^  t4MMsU>. 


2)    Write  down  what  you  find  out  about  how  the  wands  make 
BUBBLES.    Put  this  information  in  a  table.    In  your 

TABLE    INCLUDE    INFORMATION   ABOUT  HOW  MANY  BUBBLES  WERE 
MADE  BY    EACH   WAND^    HOW  BIG   THE   BUBBLES   WERE/   AND  THE 
SHAPES   OF.   THE  BUBBLES. 
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Third  ^rade    Score  PoiinT  'I 
Explain  what  you  found! 

3)  Look  back  at  th^  notes  in  your  table- 

4)  What  happens  to  the  number  and  size  of  the  bubbles  as 

THE /WAND   GETS   UVPGER?  ^ 

.  /r/?y)/^aj  ^-—^ 


Explain  what  you  found: 

3)  Look  back  at  the  notes  in  your  table- 

4)  What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


oExplain  wHiU"  YQu  pound; 


3)  l^OOK  BACK  AT  THE   NOTES    IN   YOUR  TABLE- 

4)  V/HAT   HAPPENS   TO   THE   NUMBER   AND   SIZE   OF   THE   BUBBLES  AS 
THE  WAND   GETS  LARGER? 
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SevefTH  Grade    Score  Point  4 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND  GETS  LARGER? 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


^^rWASDlE^s'LAJGERr''^'  ''''  ''''''' 

^^^^^  OAfi  Jq^j  ^'jU^UMi^ 


ERIC 
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Eleventh  Grade    Score  Point  4 


What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND   GETS  LARGER? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 
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Third  Grade    Score  Point  3 
Explain  what  you  Fmi^p.  ^   

■.3)     Look  .BACK. .AT  _THE.. NOTES, IN  .YOUR  .TABLE.  ..^  

4)  .  What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND  tSETS   LARGER?        ..  j.. 


D7 


h4  -Vh-^*  -'^l7f 


0 


AT 


MBEl?  AND  SIZE  OF 


^\  V*^  -^"i^P^         THE  WA,ND  .  CHANGES?  .  J 

'>^L1.^.  ^.QSer  ^^^^^^ 


THE  iBUBBLES 


Explain  what  you  FmiNpf 

3)    Look  back  at  the  notes  in  your  table. 

^)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


Lh 


r^r^i^  _SZJ  ^ 


ERIC 
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T-emtH  PRADE     !-CORE  foiMT  3 

i 

4)    What  happens  tc  the  number  and  size  of  the  bubbles  as  ^ — ^ 

TH^  WAND   GETS   LARGER?  /  \ 

Gb^^\\  \  V^vcV^Uc7  g^g-vT^  (3), 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE   WAND   GETS  LARGER? 


^)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


ERIC 


3S6 


Eleventh  tirade    Score  Point  3 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 

r6}nf^kftnrh    


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


t 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 

the  wand  gets  larger?  , 

"TWO  ^p^-^or^Dor^Hi^o  ->i?.o  MP  -yt^l^  ^ 
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Thi'rd  Grade    Score  Point  2 


Explain  what  you  found; 

3)  Look  back  at  the  notes  in  your  table- 

4)  What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger?         ^     a  /i  /i  " 


Explain  what  you  found! 

3)  Look  back  at  the  notes  in  your  table- 

4)  What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


£xplajn  what  you  found: 

3)    Look  back  at  the  notes  in  your  table- 

^)    What  happens  to  the  number  and  size  of  the  bubbles  as 

•  THE  wand  gets  LARGER? 

\\hen-  Hxq^  warJ  ^^^^  ^^Jg^^ 


ERIC 


^B/Em  '^RADE    Score  Point  2 


V 


4)    What  happens  to  the  number  and'  size  of  the  bubbles  as 
the  wand  gets  larger? 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


^^^^^^^ 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  W/ 


rHE^A^D   GETS   LAFIGER;^  p. 


rrrvo  ^Cy?^  " 
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Eleventth  Grade    Score  Point  2 


^)    What  happens  to  the  number  and  size  of  the  bubbles  as 

the^and  gets  larger?  ^   ^ 


^)    What  happens  to  the  number  and  size  of  the  bubbles 
the  wand  gets  larger?  / 

Ht  Um^ef  Tern  \^ 

^0    Ur  i'/\f6-£rr<L 


^)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND   GETS   LARGER?  ^ 

4lrt^    (>Aa  ^^^^^ 
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Third  Grade    Score  Point  I 

Explain  what  vnii  cnimp. 

3)    Look  back  at  the  notes  in  your  table. 

?H"E\rN\'^^?s'?AL"E%r''^^  ''''  °^  BABBLES  AS 


;unBtK   AND   SIZE   OF  THE  BUBBLES  AS 


EXPLATH   WHAT   ynii   en. .pp. 

3)    Look  back  at  the  notes  in  your  table. 


EXPr.AIN   WHAT   vnil  pniiMp. 

3)    Look  back  at  the  notes  in  vour  table. 

"     r".'e\ZT^.s'l,Z.r''''  -  BUBBLES  A 

^^^^^  1^-^^  ln.A\^l^\^< 


I 
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Seventh  Grade    Score  Point  1 


4)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND   GETS  LARGER? 


^)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


"f^^ M^:'^.^^^^^^  '^'^  -  BUBBLES  AS 


ERIC 
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Eleventh  Grade    Score  Point  1 


What  happens"  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 


What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  WAND  GETS  LARGER? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  wand  gets  larger? 

  \^  ^t^rnor^  s^a  f?<.  ~^ a  A  rh  ' 


403 


Third  ^rade    Score  Point 


Vhat  happens  to  the  number  and  size  of  the  bubbles  as 
tme  shape  of  the  wand  changes? 
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Seventh  Grade    Score  Point  5 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


1 


5- 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


5)    What  happens  to  the  number  and  size  of  th&. bubbles  as 
the  shape  of/the  wand  changes? 


HE   SHAPE  OF/THE  WAND  CI^GES  r  ,      '  Z/  ^ 
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Eleven™  '^rade    Score  Poimt  5 


5J     WHAT  HAPPENS  TO  THE  NUMBER  AND  SIZE  OF  THE  BUBBLES  AS 
THE  SHAPE  OF  THE  WAND  CHANGES? 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


5)     WHifir  HAPPENS  TO  THE  NUMBER  AND  SIZE  OF  THE  BUBBLES  AS 
THE  SHAPE  OF  THE  WAND  CHANGES? 
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Sevei^h  Grade    Score  Poim"  4 


What  happens  to  the  number  and  size  of  the  bubb^s  as 
the  shape  0-  the  wand  changes? 


HE   SHAPE  0-  THE  WAND  CHANGES?  ^  //J 


What  happens  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 
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Eleventh  Grade    Score  Point  ^ 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


5)    What  happens  to  the  number  and  size  of  the  bubbles  a<; 

THE   SHAPE  OF  THE  WAND  CHANGES?  ^UBBl-bS  AS 


& 
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Thi.rd  Grade    Score  Point  3 


{AT  PfAPPE^S  Ti7iWE''N\jMBh?  AND"  SIZE  OF  fUE  6'UBBLES  Is 
HE  SHAPE  OF  THE  WA,ND  CHANGES?  ,  4^. 


Y  0  \/\        c  cv  y\ 

W  (  4  h    a  s 
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SEVom  Frade    Score  Poimt  3 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


 sVcy.n-p     "-frav/^    ^r^^-Vi  rnVNcV 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  shape  of  the  WAND  CHANGES? 


 CLCzC-J  OOi  ^  ArcJf^jS 


— <k^4*^*^<^  ^  h\C^^'  bij       ^-Kg  .  f^/a 

15. 
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ElB/ENTH  f^RADE     ScGRE  PqINT  3 


5)    What  happens  to  the  number  and  size  of  the  bubbles  as 

THE  SHAPE  OF  THE  WAND  CHANGES?  "«BLtb  AS  ^^^^ 
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Third  Grade    Score  Point  2 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the.  wand  changes?  . 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  _5hape  of  the  wand  changes? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 
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J^EVENTH  ^RADE     ScORE  PoifiT  2 


What 

THE 


HAPPENS   TO  THE 


NUMBER  AND 
CHANGES? 


SIZE  OF   THE   BUBBLES  AS 


;  SHAPE  OF  THE  WAND  CHANGES?    .  k  H  ^ 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 
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Eleventh  Grade    Score  Point  2 
What  happens  to  the  number  and  i?iZE  of  the  bubbles  as 

THE   SHAPE  OF  THE  WAND  CHANGES? 

  ilAe  hMl^4  Arc  


What  happens  to  the  number  and  size  of  the  bubbles  as 

THE   shape  of  the  WAND  CHANGES? 


What  happens  to  the  number  and  size  of  the  bubbles  as 

THE   shape  of  the  WAND  CHANGES? 
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,   ■^o.A 

Third  ^rade    Score  Point  I 


!?S^^cu?^^^^^  ^°  ^^^^^^  AND  SIZE  OF  THE  BUBBLES  AS^  | 

THE  SHAPE   OF  THE  WAND  CHANGES?  (  [ 


i 


What  happens  to  the  number  and  size  of  the  bubbles  as 

TH^  SHAPE  OF  THE  WAND  CHANGES?  A         fi /] 
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Seventh  ^irade    Score  Point  1 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


V-Vmv^  Vur>-^  \Vo    larger  onej  


What  happens  to  THe  number  and  size  of  the  bubbles  as 

THE   SHAPE  OF   TW*   WAND  CHANGES?  Z^- 

dcd^r  ^tNy^  ^b\c>\qS~^ 

Qnc::^   ^Hag^  Sl'ge  rjl^dH-ni:  c)--^<:^.\-^Q 
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ELEvem^  Grade    Score  Poimt  1  ^^g^'V  ^ 


What  happens  to  the  number  and  size  of  the  bubbles  as  v 
the  shape  of  the  wand  changes?  /"^x 


What  happens  to  the  number  and  size  of  the  bubbles  as 
the  shape  of  the  wand  changes? 


What  happens  to  the  number  and  size  of  the  bubbles  as 

THE   SHAPE  OF  THE  WAND  CHANGES? 
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Comments  on  Bubbles  (Grades  3,  7,  and  11) 

The  Advisory  Panel  agreed  that  the  Bubbles  apparatus  was  not  an 
appropriate  basis  for  collecting  data  because  the  apparatus  yielded  very 
inconsistent  findings.    For  example,  it  may  have  been  difficult  for  students 
to  control  the  rate  of  blowing  through  each  of  the  wands  or  the  viscosity  of 
the  solution  between  trials.    Thus  it  would  be  unduly  difficult  for  students 
to  interpret  their  results. 

However,  the  data  indicates  that  86  percent  of  the  third  grade  students 
completed  the  table  of  information  based  on  their  findings.    Similarly,  34 
percent  of  the  seventh  graders  and  68  percent  of  the  eleventh  graders  made  and 
completed  their  own  table  of  findings.    Also,  the  consultants  agreed  that 
exercises  which  tap  the  ability  to  collect  and  organize  data  are  needed. 

Therefore,  a  recommendation  for  future  use  might  be  that  questions 
comparable  to  those  posed  in  this  exercise  be  asked  with  different  materials 
that  produce  more  consistent  results. 
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GRADE  11 


STATION  6 

Box  X   CONTAINS  0N£  OF   THE   FOLLOWING   SETS   OF  OBJECTS- 


"^1 

jN 

5 

c 

=3 


Msftncu  Mapnet  Mafnett 


D 

E 

Iron  1 

lAhnRitrnm 

1 

The  set  of  objects  is  fixed  firmly  but  not  necessarily  in  the 
position  shown  above- 

Here's  what  you  nn: 

1-  Put  box  X  on  the  rectangle  drawn  on  the  attached  page, 

WITH   THE   LETTER  X   TO   THE   RIGHT   AS  SHOWN- 

2-  Hut  a  compass  on  each  circle  in  turn  and  draw  an  arrow 

IN  THE  CIRCLE   SHOWING  THE  DIRECTION  THAT  THE  NEEDLE 
POINTS- 

3-  Take  the  box  off  the  paper- 

4-  From  the  direction  of  the  arrows,  work  out  which  set  of 
objects  is  in  the  box- 

5-  The  set  of  objects  that  is  in  box  X  is: 
A_    B_    C_    D_  E_ 

6-  Draw  clearly  in  the  rectangle  on  the  attached  page  how 
your  chosen  set  of  objects  is  placed  in  box  x- 

7-  Briefly  explain  why  you  have  chosen  this  set  of  objects. 


o  47  Q 
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Activity  Identification:    Magnet  and  Compass 
Grade(s):  11 

Method  of  Administration:    Self -Administered  Station  Activity 
Content  Area:  Science-Physics 

Apparatus  required:    Sealed  box  labelled  X  containing  two  bar  magnets  fixed 
firmly  in  position  (see  diagram  below),  a  compass,  a  work  sheet  depicting  a 
rectangular  box  the  same  size  as  box  X  and  ten  circles  around  the  perimeter  of 
the  rectangle  (see  attached  sheet),  paper  and  pencil. 

Administration:    Magnets  should  be  stored  separately  from  the  compasses  to 
avoid  any  potential  changes  in  polarity  of  the  compasses.    Blue  end  of  arrow 
indicates  north. 

Servicing:    None  required 
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Magnet  and  Compass 
Station  A 

Grade  11  -  station  6 


Scoring  of  the  Written  Responses 

llVrl  L'i''        the  Student  checks  the  appropriate  set  of  objects 

score  0  if -the  :tudLt''\'  "^^"^^  Inaccur^ti^'J^ice. 

Dcore  u  ir  tne  student  makes  no  response. 

o'r^Intf^!'^'•  f"'^""  '^""^  '""^  °^J^^^«        '^he  appropriate 

orientation.     Score  1  pt.  if  the  student  draws  the  objects  in  an 
inappropriate  orientation.     Score  0  if  the  student  makes  no  «s"onse, 

llTJ.  ".'''^  provides  an  accurate  or  plausible  reason 

referencrto%S'°"  °'  "'^^^^^  ^"       '''^^^'^  ^^-1^  include  a 

lllll  l  t         ?  ^  P*^-  if  the  student  provides  an 

iroMp"  '  r  Jf"^^^^"'  explanation  for  why  she  or  he  chose  the  sec 
of  Objects  in  5).     Score  0  if  the  student  gives  no  response. 

Skills  involved 


ERIC 


B-EVErfTH  Grade    Score  Ponfr  2 


5.    The  set  of  objects  that  is  in  box 
AJC   B_   C_   D_  E_ 


5.    The  set  of  objects  that  is  in  box-X^js: 

(a^  b_  c_  d_  e_ 


5.    The  set  of  objects  that  is  in  box  X  is 
A^   B_   C_   D_  E_ 
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Eleventh  Grade    Score  Point  1 


The  set  of  objects  that  is  in 
A        B  _   C  _   D  2!L   E  ^ 


Be^X  IS: 


The  SET  OF  objects  that  is  in  box  ^  is: 
A  _   B  _   C  X  D  —   E  _C_nJ 


The  set  of  objec.o  that  is  in  box  X  is: 
A  _   B        C  _   D  _  E 
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Eleventth  Grade    Score  Poir^rr  2 


Eleventh  Grade    Score  Point  2 


426 
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Eleventh  Grade    Score  Point  2 


?•    Briefly  explain  why  you  have  chosen  this  set  of  objects.  C^^^. 


dQ^Ai^)  Ztic  l&lco  <^  ^  ^ 


Briefly  explain  why  you  have  chosen  this  set  of  objects. 


box  xkiUAJi    if  affdiA^  pOiAkdi  aiA)OJU^^ 


Briefly  explain  why  you  have  chosen  this  set  of  objects. 
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Eleventh  Grade    Score  Point  1 


Briefly  explain  why  you  have  chosen  this  set  of  objects- /^\^ 


Briefly  explain  why  you  have  chosen  this  set  of  oBjicrs- 


Briefly  explain  why  you  have  chosen  this  set  of  objects. 
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Comments  on  Magnets  and  Compass  (Grade  11) 

In  this  exercise,  students  were  asked  to  determine  the  identity  of  an 
unknown  apparatus.    Students  had  to  assess  the  results  of  their  test  and  infer 
whether  the  unknown  was  two  bar  magnets  arranged  with  poles  in  the  same 
direction,  a  horseshoe  magnet,  two  bar  magnets  arranged  with  poles  in  opposite 
directions,  an  iron  bar,  or  an  aluminum  bar. 

The  two  bar  magnets  arranged  parallel  were  correctly  selected  as  the 
unknown  by  39  percent  of  the  students.    The  most  common  errors  were  selection 
of  either  the  bar  magnets  arranged  antiparallel  or  the  horseshoe  magnet.  Most 
of  the  students  who  selected  the  correct  unknown  also  selected  the  proper 
orientation  of  the  unknown  within  the  box.    About  25  percent  of  the  students 
correctly  explained  why  they  had  chosen  the  correct  unknown.    The  pilot 
results  indicate  that  more  males  correctly  completed  this  task  than  females. 

The  advisory  panel  agreed  that  the  exercise  was  content  oriented  and 
that  males  may  have  had  more  previous  experience  with  such  equipment. 
However,  they  felt  the  task  was  appropriate  for  eleventh  graders. 

The  administrators  reported  that  the  students  liked  "experimenting"  with 
the  apparatus.  The  apparatus  is  small  and,  with  proper  instruction,  it  is  very 
easy  to  set  up  and  maintain.    This  exercise  is  appropriate  for  eleventh 
graders  in  a  future  national  assessment. 
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GRADE  7 


STATION  6 


Do  SUGAR  CUBES  DISSOLVE  FASTER  THAN  LOOSE  SUGAR?  WhAT  EFFECT 
DOES   STIRRING    THE  WATER  HAVE? 


Here's  what  you  do: 

Find  out  whether  sugar  cubes  dissolve  faster  than  loose  sugar. 

You  may  use  the  equipment  in  front  of  you.  Each  package  contains 
the  same  amount  of  sugar  as  one  cube. 

What  did  you  find; 

1)    Briefly  describe  what  you  did  to  compare  how  fast  the 
TWO  kinds  of  sugar  dissolved. 


2)    Fill  in  the  the  blank  spaces  :n  the  sentences  below  to 
show  what  you  found. 


When  the  water  was  s'Irred^ 
faster. 


When  the  water  was  not  stirred^  the 
dissolved  faster. 


DI SSOLVED 


Explain  what  you  FOiiNP: 

3)    Write  your  explanation  of  these  results. 


ERIC 
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Activity  Identification:    Sugar  Cubes 
Grade(s):  3,7 

Method  of  Administration:    Individually  Administered  Investigation  (3), 
Self -Administered  Activity  (7) 

Content  Area:  Science-Chemistry 

Apparatus  required:    Six  small  glass  beakers,  sugar  cubes  in  packet,  six 
packages  of  granulated  sugar  each  containing  the  same  mass  of  sugar  as  in  one 
cube;  stop  clock  hot  water  in  thermos 

servicing:    None  required 
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Sugar  Cubes 
Station  A 

Grade  7  -  station  6 


Scoring  of  the  Written  Responses 

1)  Score  3  pts.  if  the  student  notes  that  the  rate  of  stirring  and  the 
amount  of  water  needed  to  be  controlled  for  in  order  to  compare  the 
dissolving  rates  of  the  two  types  of  sugar.     Score  2  pts.  if 

the  student  only  notes  one  of  the  variables.     Hierefore  the  student 
cites  one,  but  not  more  than  one,  of  the  following:  stirring  and  not 
stirring    controlling  for  these  two  types  of  trials  (stirring  and  not 
stirring),  the  amount  of  water  in  each  beaker,  the  rate  of  dissolving 
for  both  types  of  sugar,  or  the  combination  of  these  sets  of 
variables.     Score  1  pt.  if  the  student  simply  describes  what  was  done 
U.e.  I  stirred  the  water)  or  what  happened  (i.e.  They  both  took  time 
to  dissolve).     Score  0  if  the  student  makes  no  response. 

2)  Score  3  pts.  if  the  student  accurately  completes  both  sentences. 
Loose  sugar  should  be  the  correct  answer  for  both  sentences.     Score  2 
pts.  if  the  student  accurately  completes  one  sentence  but  not  the 
other.     Score  1  pt.  if  the  student  inaccurately  completes  both 
sentences.     Score  0  if  the  student  makes  no  response. 

3)  Score  5  pts.  if  the  student  provides  a  plausible  reason  that  is 
consistent  with  the  responses  in  2).     Score  4  pts.  if  the  student 
provides  a  plausible  reason  that  is  inconsistent  with  the  findings  in 
2).     Score  3  pts.  if  the  student  provides  an  erroneous  reason  but  is 
consistent  with  the  responses  in  2).     Score  2  pts,  if  the  student 
provides  an  erroneous  explanation  that  is  inconsistent  with  the 
responses  in  2).     Score  1  pt.  if  the  student  provides  a  descripMon 
of  the  findings  only.     Score  0  if  the  student  makes  no  response. 

Skills  involved 

In  this  exercise  the  student  needs  to  determine  how  the  independent 
^^mak^n/i^.^^'  f  ^'^^P^^^f"'^  variable.     This  relationship  can  be  determined 
by  making  detailed  observations  involving  comparisons  and  contrasts. 
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v^EVE^rTH  r-RADE     vScORE  PQINT  3 

What  did  you  find: 

1)    Briefly  describe  what  you  d  id  jo  compare  how  fast  the,  jy" 
TWO  kinds  of  sugar  dissolved- ^Yft-  VVrivO^^'' 


1)    Briefly  describe  what  you  did  to  compare  how  fast  the 
TWO  kinds  of  sugar  dissolved-  . 

 -^^vAA^ns^-i  ^      >rj3ti^w^  "-<U>v^.,^(  fA^Jc^^ 
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?EVEm-H  ^^RADE     ScORE  PoiNT  2 


Briefly  describe  what  you  did  to  compare  how  fast  the 


TWO  KINDS  OF  SUGAR  DISSOLVED- 


Briefly  describe  what  you  did  to  compare  how  fast  the 
two  kinds  of  sugar  dissolved. 

Ct    pocV:(L^>^  r>  ^   gcvCfO^  \rsG\  "^^C    savnc:  Xivn^  CbnJl 


Briefly  describe  what  you  did  to  compare  how  fast  the 
TWO  kinds  of  sugar  dissolved. 
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Seventh  Grade    Score  Point  1 


Briefly  describe  what  you  did  to  compare  ho^  fast  the 
two  kinds  of  sugar  dissolved* 


Briefly  describe  what  you  did  to  compare  how  fast  the 

TWO  KINDS  OF  SUGAR  DISSOLVED- 


 /Mid  yj^-jjiJAC^ 


Briefly  describe  what  you  did  to  compare  how  fast  the 

TWO   KINDS  of  sugar  DISSOLVED- 
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Seventh  Grade    Score  Point  1 


2)    Fill  in  the  the  blank  spaces  in  the  sentences  below  to 
show  what  you  found* 

When  the  water  was  stirred^  the     '5»  U£^C/f      dissolved/^  iX 

FASTER.  ^  V  ) 

When  the  water  was  not  stirred,  the    ^V<2l/7/^  /^uH-^ 
dissolved  faster.  c/ 

SevEmn  ^^RADE    Score  Point  2 

2)    Fill  in  the  the  blank 'spaces  in  the  sentences  below  to 
show  what  you  found. 


When  the  water  was  stirr:^,  the  yJd&M  A4ja/0A  dissolv 

FASTER.  ^  7] 

Wm2n  the  water  was  not  stirred,  the  QjlDuI  JjfjfjQ^f) 
dissolved  faster.  i 

SEVEm'H  r-RADE     ScORE  ^01  NT  3 


2)    Fill  in  the  ths  blank  spaces  in  the  sentences  below  to 
show  what  you  found. 

When  the  water  was  stirred,  the    Aqo^  ^^UyxC  dissolveiZ-^jJ^ 

FASTER.  I  J/ 

^WHEN   the  water  WAb  NOT  STIRRED,   THE    \(Xf^  ^^i*,A  f 
DISSOLVED   FASTER.  ^ 
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Seventh  Grade  Score  Point  5 


Explain  WriAT  you  found:  /"y^ 
3)    Write  your  explanation  of  these  results.  / 


Explain  what  you  FmiMn; 

3)    Write  your  explanation  of  these  results. 


Explain  what  you  found! 

3)    Write  your  explanation  of  these  resuuTs.  ^ 
^'^jt^  vXA^e^  Jkj^cycy^  ^JW^  JL^y  w&*iflLdi>-  vJ)^^u>^ 
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Peventh  ^rade  Score  Point  ^ 


EXPLATN   WHAT   Ynil    pnil[Up  •   

3)    Write  your  explanation  of  these  results-  3 


Explain  what  you  FniiNn; 

3)    Write  your  explanation  of  these  results- 

Explain  what  you  Fnufap. 

3)    Write  your  explanation  of  these  results- 


ERIC 
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Seventh  Grade  Score  !~'oint  3 

EXFLATU   WHAT   Yni,'  FO'^Nf?' 

3)    Write  your  explanation  of  these  results. 

VV\e  suCj^ar   coa-^    \::>e^<^3  vvxi^cfd 

Explain  what  ynn  Fn'TP- 

3)     WrI-^  YOOR  explanation  of  TpSE  RESULTS-    ^  ( 


Explain  what  you  FouNn: 

3)    Write  your  explanation  of  these  results- 


ERIC 
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SEVEf^  f^^RADE    Score  Point  2 

Explain  what  you  Foimn! 

3)    Write  your  explanation  of  these  results.  — \ 

4Q.sVer  Vhan  cu       sugar    WcoLuge  \\-  \  s,  t^.^V  
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Seventh  ^rade    Score  Point  1 


\ 


EXPLATN   WHAT   Ynil  pnil|jp. 

3)    Write  your  explanation  of  these  results. 


Explain  what  you  Fonf^p. 

3)    Wrj^te  your  explanation  of  these  results.  ^ 

^   KfwVA.  ^Wa^   ^iTc.  CiJ^  ' 


Explain  what  you  Fnimp! 

3)    Write  your  explanation  of  these  results. 
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Comments  on  Sugar  Cubes  (Grade  7) 

The  consultants  agreed  that  the  abbreviated  version  of  Sugar  Cubes  as  a 
station  exercise  was  not  appropriate  to  include  in  a  national  assessment. 
(This  recommendation  did  not  apply  to  Sugar  Cubes  as  a  full  investigation). 
The  eight  minutes  allotted  for  station  activities  was  far  too  short  a  period 
of  time  for  the  students  to  be  able  to  conduct  what  waj  potentially  a  full 
scale  experiment. 
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GRADE  3 


STATION  4 


Which  magnet  is  stronger? 


Herr  are  two  ways  you  can  tell  which  magnet  is  stronger: 

A)  Test  to  see  how  much  each  magnet  can  pick  up. 

B)  Test  how  hard  each  magnet  can  pull  or  push  another 

MAGNET. 
HeRE*S  what   you  DO! 

1)  Test  which  magnet^  A  or       is  stronger- 

Explain  what  you  foijnd! 

2)  Which  magnet^  A  or  B^  is  stronger?    Why  do  you  think  so? 
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Activity  Identification:    Magnets  (strength) 


Grade(s):  3 

Method  of  Administration:    Self-Administered  Station  Activity 
Content  Are3:  Science-Physics 

Apparatus  required:    Two  disk  magnets  labelled  A  and  R  that  are  comparable  in 
nass,  size,  shape,  and  external  appearance  (strength  of  magnets  should  be  such 
that  one  magnet  is  4-5  times  stronger  than  the  other  one);  paper  clips;  small, 
round  flat  markers,  plastic  buttons,  paper  and  pencil « 

Administration:    Magnets  should  be  placed  a  bit  away  from  the  other  piles  of 
like  objects  as  suggested  in  the  diagram  below. 

Servicing:    None  required 


Magnets  (strength) 
Station  B 

Grade  3  -  station  4 


Scoring  of  the  Written  Responses 

2)    Score  3  pts.  If  the  student  provides  one  or  more  plausible  reasons 

why  magnet  A  is  stronger  than  the  other.  This  reason  may  be  based  on 
the  Instructions  In  part  A). 

Score  2  pts.  If  the  student  specifies  correctly  that  magnet  A  Is 
stronger  than  magnet  B  without  providing  a  plausible  reason. 

Score  1  pt.  If  the  student  specifies  the  wrong  magnet  with  or  without 
a  reason. 

Score  0  If  the  student  makes  no  response. 
Skills  Involved 

In  this  exercise  the  student  must  determine  which  of  two  magnets  Is 
stronger  based  on  comparing  and  contrasting  the  capabilities  of  each  magnet. 
The  student  may  use  her  or  his  own  test  of  magnet  strength  or  use  the  two 
methods  provided  in  the  instructions.     Based  on  the  student's  findings,  she  or 
he  must  then  iufer  which  is  the  stronger  magnet. 
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Third  Grade    Score  ?oim  3 

Explain  what  vnii  pnn^p. 

2)    Which  magnet.  ®or      is  stronger?    Why  do  you  think  so? 


FXPLAIN  WHAT   YOU   FOUND;  /V 

2)    Which  magnet.  A  or  B.  is  stronger?    Why  do  you  think  so?  y 


Explain  what  you  founp; 

2)    Which  magnet.  A  or  B/  is  stronger?    Why  do  you  think  so?  <^ 

_tip  ■—  
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Thi'rd  Grade    Score  Poim-  2 

hXPLAIN  WHAT  YOU  FOUND: 

2)    Which  magnet^  A  or       is  stronger?    Why  do  you  think  so? 


Explain  what  you  found! 

2)    Which  magnet^  A  or       is  stronger?    Why  do  you  think  so? 


FxPtAIN  WHAT   YOU    FOUND : 

2)    Which  magnet^  A  or  B^  is  stronger?    Why  do  you  think  so?  2- 
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Third  'hrade    Score  Point  1 


Explain  what  you  Pnimp. 

2)    Which  MAGNET.  A  or       is  stronger?    Why  do  yo'j  THi'iK  so?  / 

"  -^^^4-  :  


Explain  what  you  found: 


2)    J^iJCH  magnet,   a  or  B.    is  stronger?     \iA^  DO  ^rOU.  JHINK^SO?  I  . 

.Explain  what  you  fo"np;  gr^^^^^^^^^^/p^g^  ^i'A^  ^Q/(Z/^^'^^2^ 

2)    Which  magnet.  A  or  B.  is  stronger?    Why  do  you  think  so? 
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Comments  on  Magnets  (Grade  3) 


In  Magnets,  students  were  asked  to  determine  which  magnet  was  stronger. 
The  task  seemed  appropriate  and  easy  at  the  third-grade  level.    The  stronger 
magnet,  A,  was  selected  by  82  percent  of  the  students  and  plausible 
explanations  of  "why"  were  given  by  56  percent  of  the  students. 

The  administrators  reported  that  the  students  liked  working  with  the 
magnets.    It  was  the  consensus  of  the  advisory  panel  that  the  exercise  was  too 
simplistic  as  presented,    ^t  was  suggested  that  it  be  made  more  challenging  by 
the  following  revision,  "Which  magnet  is  stronger,  A  or  B?    Why  do  you  think 
so?"    This  would  allow  students  to  design  their  own  testing  methodology. 

Because  the  second  method  is  not  useful  in  determining  which  magnet  is 
stronger,  another  suggestion  was  "Lo  assess  the  two  methods  separately  and 
revise  the  questions  as  follows: 

What  is  your  result  using  Method  A? 

What  is  your  result  using  Method  B?  or 

What  did  you  find  out  using  Method  A?  etc. 

The  revised  exercise  could  be  used  at  all  grades.    The  materials  are 
small  and  very  easy  to  set  up  and  maintain.    This  exercise  could  be 
appropriate  for  any  future  national  assessment  if  a  commercial  source  for  the 
magnets  is  found  and  if  it  is  revised  and  pilot  tesced. 
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CHAPTER  3 


FULL  INVESTIGATIONS 
BACKGROUND 

FORMAT  OF  THE  FULL  INVESTIGATIONS 
ANALYSES 


Activity  Identification 


Grade(s) 


Sugar  Cubes 


3 


Pegboards 


3,  7,  11 


Density 


7,  11 


Survi  Viil 


7,  11 


Background 

These  exercises  require  students  to  design  and  conduct  an  experiment 
investigating  a  problem  posed  by  an  administrator.    As  the  student  works  on 
the  problem,  the  administrator  is  responsible  for  recording  the  student's 
behaviors  on  a  checklist.    Immediately  following  the  investigation,  the 
student  is  asked  questions  concerning  the  experiment.    The  students'  oral 
responses  also  are  recorded  by  the  administrator.    In  these  exercises,  the 
purpose  for  collecting  information  about  the  student's  behaviors  and  oral 
responses  is  to  gain  an  understanding  of  how  students  apply  higher-order 
thinking  to  their  investigation  of  perceived  scientific  concepts  in  an 
experimen;*.al  sett i  ng. 

The  full  investigation  exercises  are  unique  because  they  offer  students 
an  opportunity  to  independently  devise  and  structure  their  own  framework  of 
problem-solving  rather  than  respond  to  one  already  presented  in  a  given 
exercise  (as  is  the  case  in  the  group  and  station  exercises).  More 
importantly,  in  order  to  devise  and  implement  this  "personalized"  approach, 
students  are  called  upon  to  use  the  full  range  of  the  aspects  of  higher  Oider 
thinking  as  specified  in  the  model  of  the  higher-order  skills  framework. 
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Three  of  the  four  full  investigations,  Sugar  Cubes  (Grade  3),  Pegboards 
(Grades  3,  7,  and  11),  and  Survival  (Grades  7  and  11)  were  adapted  from  full 
investigations  developed  by  the  APU  science  monitoring  project.  Modifications 
were  made  to  these  exercises  in  accordance  with  the  APU  recommendations  for 
use  in  the  NAEP  pilot  test  and  included  an  abbreviated  checklist  of  behavior 
and  a  single  column  to  record  the  behaviors  for  one  trial  of  experimentation 
(the  APU  had  used  multi-column  checklists  to  better  record  the  student's 
behavior  across  several  trials).    These  revisions  enabled  NAEP  to  administer 
the  full  investigations  given  the  limited  number  of  administrators  and  time 
available  to  train  them.    However,  the  manner  in  which  the  full  investigation 
problems  were  presented  to  the  students  was  comparable  to  that  used  by  the  APU 
for  their  sample  except  for  those  issues  mentioned  earlier  in  Part  I  of  the 
report. 

The  fourth  full  investigation.  Density  (Grades  7  and  11),  was  developed 
by  NAEP. 

Format  of  the  Full  Investigations 

All  full  investigations  were  comprised  of  a  script,  a  behavioral 
checklist,  and  a  student  response  sheet.    The  scripts  were  read  by  the 
administrator  to  the  student  and  provided  an  introduction  to  the  problem  and 
the  task.    All  scripts  were  the  same  for  ell  students  within  a  given  exercise. 

The  behavioral  checklists  were  filled  in  by  the  administrator  as  the 
student  worked  on  the  problem.    Because  single  column  checklists  were 
provided,  the  administrator  was  to  simply  check  whether  a  behavior  did  or  did 
not  occur  during  the  student's  work  regardless  of  how  many  times  the  student 
might  have  stopped  and  started  over  again.    All  checklists  were  divided  into 
sections  which  contained  behaviors  that  were  appropriate  to  the  type  of 
problem  set  (e.g.  problems  concerned  with  single  variable  relationships). 
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These  behaviors  included  those  which  were  related  to  the  independent  variable 
and  how  it  is  var-'ed  (e.g.  stirring  or  not  stirring  trials  in  Sugar  Cubes ) ; 
manner  of  measurement  of  the  dependent  variable  and  associated  techniques 
(i.e.  timing  the  number  of  swings  in  Pegboards ) ;  and  metiiodol ogi cal  awareness 
(i.e.  acknowledgement  that  aspects  of  the  experiment  could  be  improved  in  all 
investigations).    The  checklist  for  Density  differed  frcm  this  format  slightly 
in  that  sections  were  divided  on  the  basis  of  type  of  measurement  and  method 
of  computing  density.    The  methodological  awareness  section  was  still 
included.    The  purpose  for  dividin^j  the  checklists  into  sections  was  to 
facilitate  the  administrators'  task  in  filling  them  in,  to  help  identify  the 
student's  behavior  on  certain  aspects  of  the  problem,  a.d  for  purposes  of 
analysis.    For  example,  the  student's  pattern  of  behavior  vvithin  the 
independent  variable  section  might  indicate  how  well  the  student  understood 
the  problem  and  which  variables  needed  to  be  manipulated  in  orde"  to  reach  a 
concl usi  on. 

The  third  aspect  of  the  full  investigation  exercises  consisted  of  a 
student  response  sheet  which  the  student  used  as  a  space  to  record  her  or  his 
findings.    These  sheets  also  included  space  for  notes  the  student  wanted  to 
make  during  work.    Fur  all  the  investigations,  the  response  sheets  were  used 
as  a  check  on  a  student's  work  rather  than  an  index  of  how  well  the  student 
reached  a  conclusion  to  the  problem. 

Analyses 

Frequency  Counts 

For  all  full  investigation  exercises,  frequency  counts  were  computed 
for  each  of  the  behavioral  checkl ist  points.    These  counts  only  included 
the  occurrences  of  a  given  behavior.    Non-occurrences  were  not  tabulated. 

Frequency  counts  also  were  computed  for  scores  assigned  to  answers  on 
the  student  response  sheets. 
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The  analyses  in  :his  project  were  limited  to  frequency  counts 
because  of    :e  small  sample  sizes.    However,  if  full  investigations  are 
used  in  a  national  assessment  more    inclusive  analyses  should  be 
conducted  to  discrimate  cinong  levels  of  student  performance. 

A  note  of  caution  should  be  added  that  the  frequency  counts  for  some 
of  the  data  may  be  either  inflo*-ed  or  deflated  because  of  administrator 
inconsistencies  in  completing  the  checklists. 
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Comments  on  Sugar  Cubes  (Grade  3) 

In  the  Sugar  Cubes  full  investigation,  students  were  asked  to  determine 
which  type  of  sugar,  loose  or  cubed,  would  dissolve  faster  in  water  when  the 
water  was  stirred  and  not  stirred.    Therefore,  the  independent  variables  in 
this  investigation  were  type  of  sugar;  loose  or  cubed  and  sti  rring  the  water 
and  not  stirring  the  water.    The  dependent  variable  was  the  rate  at  which  the 
sugar  dissolved.    The  loose  sugar  dissolved  faster  under  both  sets  of 
conditions. 

Review  of  the  Frequency  Data 

Review  of  the  data  from  the  students'  response  sheets  indicates  that  the 
task  was  appropriate  for  third-grade  students.    Eighty--Lwo  percent  identified 
loose  sugar  as  dissolving  faster  than  the  cube  sugar  and  about  21  percent 
accounted  for  how  stirring  affected  the  difference  in  rate  between  the  two 
sugars. 

For  those  students  who  conducted  either  a  set  of  stirring  or  non-stirring 
trials,  a  large  percentage  of  the  students  tested  both  types  of  sugar.  For 
example,  for  the  not  stirring  trials,  about  56  percent  tested  the  loose  sugar 
and  73  percent  tested  the  cube  sugar.    Similarly,  for  the  stirring  trials,  80 
percent  tested  the  loose  sugar  and  94  percent  tested  the  cube  sugar. 
Apparently,  there  is  substantial  overlap  between  students  who  tested  both 
types  of  sugar  for  each  set  of  stirring  and  not  stirring  trials.    A  smaller 
percentage  of  students  demonstrated  conservation  of  the  mass  of  sugar  and 
volume  of  the  water  for  each  of  the  trials.    For  example,  for  the  not  stirring 
trials,  30  percent  of  the  students  controlled  for  the  volume  of  the  water  used 
to  test  the  sugar  and  about  51  percent  controlled  for  the  mass  of  sugar 
tested.    Similarly,  for  the  stirring  trials,  46  percent  of  the  students 
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controlled  for  the  volume  of  water  and  70  percent  controlled  for  the  mass  of 
the  sugar.    A  review  of  the  student's  use  of  the  apparatus  such  as  the 
graduated  cylinder  indicated  that  6  percent  of  the  students  used  the  cylinder 
to  measure  water  for  the  not-stirring  trials  and  4  percent  of  the  students 
used  the  cylinder  for  the  stirring  trials.    By  comparison,  49  percent  of  the 
students  measured  the  water  by  eye  for  the  not-stirring  trials  and  72  percent 
of  the  students  measured  the  water  by  eye  for  the  stirring  trials. 

An  indication  of  how  reliably  students  measured  the  dependent  variable 
might  be  indexed  by  how  many  students  made  qualitative  measurements  and/or  no 
apparent  measurements.    A  review  of  the  frequency  counts  indicates  that  for 
the  not  stirring  trials,  8  percent  of  the  students  made  no  apparent 
measurements  and  42  percent  made  qualitative  measurements.    For  the  stirring 
trials,  13  percent  of  the  students  made  no  apparent  measurements  and  66 
percent  made  qualitative  measurements.    These  counts  suggest  that  these 
younger  students  tended  to  rely  upon  qualitative  measurements  more  so  than 
objective  measurements. 

Recommendations  for  Future  Use 

The  Advisory  Panel  agreed,  after  reviewing  the  preliminary  data,  that 
Sugar  Cubes  would  be  an  appropriate  exercise  for  third  grade  students  in  an 
assessment  situation.    It  appeared  that  these  students  took  measurements  and 
conducted  an  investigation.    A  closer  look  at  the  data,  however,  indicates 
that  third  grade  students  may  havo  had  difficulty  determining  which  were  the 
independent  and  dependent  variables  and  how  best  tj  test  them.    Given  ^.his 
difficulty,  a  recommendation  for  future  use  of  this,  exericse  among  a  third 
grade  population  would  be  to  include  a  smaller  scale  study  where  sl'.udents  are 
asked  to  work  with  a  single  independent  variable.    The  Advisory  Panel  also 
suggested  that  the  checklist  be  restructured  so  that  the  order  in  which 


behaviors  were  demonstrated  could  be  recorded,  and  also  to  include  some 
summary  statements  which  would  note  whether  a  student  tested  both  types  of 
sugar  for  a  given  trial.    The  Panel  noted  that  the  questions  on  the  response 
sheet  should  be  worded  more  clearly  so  that  students  better  understand  what 
sort  of  answer  is  required. 

A  final  recommendation  would  be  to  include  more  extensive  training  of  the 
administrators  on  this  exercise  so  that  they  would  be  better  able  to  observe 
students*  behavior  and  fill  in  the  checklists  more  efficiently. 
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Comments  on  Pegboards  (Grades  3,  7,  and  11) 


In  the  Pegboards  full  investigation,  students  were  given  a  set  of  nine 
different  boards  of  three  different  lengths  and  three  different  widths  and 
asked  to  determine  whether  length  or  width  would  affect  how  fast  the  board 
swings.    Therefore,  the  independent  variables  were  length  and  width  and  the 
dependent  variable  was  the  rate  at  which  a  given  board  would  swing.    For  this 
particular  investigation,  length  was  the  key  variable  with  shorter  boards 
swinging  faster  than  longer  boards.    Width  had  a  very  small  effect  on  the  rate 
of  swing. 

Review  of  the  Frequency  Data 

A  review  of  the  frequency  data  for  the  students'  response  sheets 
indicated  that  students  in  third,  seventh,  and  eleventh  grade  were  aware  that 
length  varied  directly  with  the  period  of  the  swing.    These  percentar  -  w.. ; . 
37  percent,  63  percent  and  61  percent  for  the  third-,  seventh-,  and 
eleventh-grade  students,  respectively.    Very  few  students  cited  the.,  width 
also  made  a  difference  (4  percent  for  the  third  graders,  9  percent    or  the 
seventh  graders,  and  27  percent  for  the  eleventh  graders)  which  sugfU:»^ts  at 
they  were  concerned  with  main  effects  only. 

A  survey  of  the  checklist  frequency  indicated  that  82  oercent  of  Vre 
third-grade  students,  84  percent  of  tho  seventh-grade  students,  and  93  percent 
of  the  eleventh-gride  students  conducted  a  test  of  length.    For  the  test  of 
width,  the  percentages  at  the  older  grade  levels  were  comparable.  However, 
many  third-grade  r.tudent  do  test  Koth  variables.    Therefore  seventh-  and 
eleventh-grade  students  v/ere  succr5;sfui  on  this  aspect.    However,  fewer 
third-grade  studt^nts  (68  percent)  conducted  a  width  test.      This  may  indicate 
a  difficulty  some  younger  students  hdve  in  dealing  with  more  than  one 
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independent  variable  as  indicated  in  the  discussion  of  Sugar  Cubes, 

The  frequency  counts  pertaining  to  the  measure  of  the  dependent  vu'iaDie 
indicated  that  some  students  timed  between  1  and  10  swings.    These  perre^'tages 
were  6  percent  for  the  third  graders,  20  percent  for  the  seventh  grade:'::,  and 
31  percent  for  the  eleventh  graders.    Both  these  sets  of  percentages     ow  that 
across  all  grades,  many  students  may  not  have  appropriately  conceptu ' i zed  the 
dependent  variable.    However,  65  percent  of  the  third  grade,  71  perceit  of  the 
seventh  grade,  and  74  percent  of  the  eleventh  grade  students  did  ineasure  the 
dependent  variable  by  making  comparisons  between  two  boards.    Most  these 
comparisons  appear  to  have  been  made  by  eye,  rather  than  using  :i  ciock  to  tiinc: 
the  rate;  82  percent  at  the  third-grade,  73  percent  at  the  sevent^^-gru^^.v  di-': 
81  percent  at  the  eleventh-grade. 

Some  students  chose  to  time  the  boards  until  the  end  of  the  movemeriC, 
thus  failing  to  derive  rate  by  considering  both  variables;  time  and 
oscillaxion.    These  percentages  were  16  percent,  15  percent  ^  ii.v:  percent 
for  the  third-,  seventh-,  and  eleventh-grade  students,  respe:^' vely. 
Recommend a tions  For  Future  Use 

The  Advisory  Panel  agreed  that  Pegboards  was  a  difficult  exercise  to 
administer  to  students  within  a  national  assessment  and  recommended  that  it 
not  be  used* 
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Comments  on  Density  (Grades  7  and  11) 

The  Density  task  differs  from  the  other  full  investigations  in  that  it 
does  not  involve  the  need  to  control  variables.    Rather,  its  interest  lies  in 
how  the  students  go  about  solving  the  problem,  which  can  be  approached  in  a 
variety  of  ways.    For  example,  some  students  may  recognize  that  the  solution 
involves  the  density  of  the  materials  and  may  know  how  to  compute  density. 
Others  can  work  out  the  answers  in  a  variety  of  other  ways  such  as  using  the 
weights  of  the  blocks  and  the  volumes  of  the  blocks  and  box,  or  by  using 
weights  and  estimations  with  or  without  measurement  of  the  blocks  and/or  box. 

Review  of  the  Frequency  Data 

Because  there  were  inconsistencies  in  the  line  by  line  records  on  the 
checklists,  the  students*  work  on  the  response  sheets  and  the  accompanying 
checklists  were  reviewed  holistically  and  the  responses  classified  ^nto  five 
types  of  approaches.    (See  Note  on  following  pci^je.)    The  score  levels  for  each 
group  were  tallied.    The  data  indicate  that  there  was  very  little  difference 
between  the  percentage  of  seventh  and  eleventh  grade  students  who  provided  the 
correct  answers.    However,  the  results  of  the  classification  suggest 
differences  between  the  grades  in  the  approach  to  solving  this  problem 
although  the  x^otal  number  of  correct  responses  at  the  two  grade  level  was 
identical.    In  grade  11,  the  direct  computation  of  density  was  most  used  and 
also  produced  the  most  scores  of  3  (both  heaviest  and  lightest  correctly 
determined).    In  grade  7,  the  most  often  used  approach  (other  than  the  variety 
of  approaches  in  other)  was  simple  estimation,  but  systematic  estimation 
produced  the  most  scores  of  3. 
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There  was  little  evidence  cf  checking  of  work  through  repeated 
measurement.    However,  some  students  did  some  reweighing  (7  at  grade  7,  and  9 
at  grade  11)  and  a  few  students  noted  weights  in  both  grams  and  ounces  and/or 
measurements  in  both  centimeters  and  inches. 

Recommendations  for  Future  Use 

This  task  may  be  more  appropriate  for  grade  7  If  the  assessment  of 
creative  thinking  is  the  goal  because  students  at  this  grade  need  to  devise 
their  own  method  to  solve  the  problem.    Some  11th  graders  may  have  a  learned 
algorithm  to  apply  if  they  recognize  its  appropriateness.    Apparently  the  task 
is  feasible  for  both  grades  and  could  be  used  in  a  national  assessment.  It 
was  suggested  that,  if  it  is  reused,  the  blocks  be  manufactured  and  made 
smaller  with  somewhat  greater  differences  in  density. 

Note:    The  five  types  of  approaches  were  defined  as  follows: 

A.  Density:    all  cases  using  a  formal  density  approach,  whether  formulas 
and/or  computations  were  correct  or  not. 

B.  Volumes :    All  cases  in  which  volumes  of  the  blocks  and  of  the  box  were 
computed,  whether  formulas  and/or  computations  were  correct  or  not. 

C.  Systematic  Estimation:    all  cases  in  which  the  number  of  blocks  to  fill 
box  was  estimated  but  estimation  was  preceded  by  measurement  of  the  blocks 
and/or  the  box  or  where  there  is  clear  evidence  of  planned  procedure. 

D.  Simple  Estimation:    all  cases  in  which  the  blocks  were  weighed  and  then 
estimation  with  no  intermediate  measurement  except,  in  a  few  cases,  just 
the  width  of  the  box  or  blocks. 

E.  Other :    all  other  cases  including  no  apparent  strategy,  meaningless 
strategy,  answer  based  on  block  weights  only,  combinations  of  methods. 
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Comments  on  Surv1 va1  (Grades  7  and  11) 

In  the  Survival  full  investigation,  students  were  given  two  types  of 
material;  blanket  and  bubble  plastic,  and  equipment  that  could  be  used  (see 
actual  exercise  for  specifications  of  equipment)  to  determine  which  type  of 
material  would  keep  them  warmer  in  cold,  dry  weather.    Therefore,  the 
independent  variables  were  type  of  material;  blanket  and  bubble  plastic  and 
the  dependent  variable  was  thermal  conduction  judged  by  the  amount  of  heat 
transfer  blocked  by  each  material.    For  this  particular  ir:v<?stigation,  the 
bubble  plastic  was  a  better  insulator  than  the  blanket. 

Review  of  the  Frequency  Data 

A  review  of  the  frequency  data  for  the  students'  response  sheets 
indicated  that  49  percent  of  the  seventh  graders  and  61  percent  of  the 
eleventh  graders  determined  that  the  bubble  plastic  would  keep  them  warmer. 
The  data  from  the  frequency  counts  indicated  that  93  percent  of  the 
seventh  graders  tested  the  blanket  material  and  89  percent  tested  the  bubble 
plastic  material.    For  the  eleventh  graders,  93  percent  teste^^  the  blanket  and 
95  percent  tested  the  bubble  plastic  material.    Therefore,  on  a  single 
discontinuous  independent  variable,  performance  was  high.    (These  results  are 
comparable  to  APU  findings). 

A  review  of  some  of  the  behaviors  pertaining  to  the  students'  set  up  of 
the  investigation  indicated  that  67  percent  of  the  seventh-grade  students 
wrapped^  the  blanket  material  around  cans  A  or  B  which  are  same-sized  metal 
cans  and  61  percent  did  the  same  for  the  plastic  material.    Similarly,  81 
percent  of  the  eleventh  graders  wrapped  the  blanket  material  around  cans  A  or 
B  and  74  percent  did  the  same  for  the  plastic  material.    These  findings 
suggest  that  the  seventh-  and  eleventh-grade  students  understood  the  testing 
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of  the  materials  well  enough  to  test  them  under  comparable  conditions,  such  as 
wrapping  them  around  a  metal  can  of  the  same  size.    (This  finding  can  be 
compared  with  performances  on  Pegboards  which  also  indicate  that  students  do 
control  variables  whose  effects  are  known).    Many  of  the  students  in  both 
grades  also  seemed  to  understand  that  hot  water,  rather  than  warm  or  cold, 
should  be  placed  in  the  cans  so  that  retention  of  heat  could  be  measured.  For 
example,  76  percent  of  the  seventh  graders  used  hot  water  for  testing  the 
blanket  material  and  70  percent  used  hot  water  for  testing  the  plastic.  For 
the  eleventh  graders,  65  percent  used  hot  water  for  the  blanket  material  and 
61  percent  for  the  plastic. 

A  review  of  the  frequency  count  data  for  the  behaviors  related  to 
measurement  of  the  dependent  variable  indicated  that  35  percent  of  the  seventh 
graders  took  baseline  readings  of  the  temperature  for  the  blanket  and  plastic 
materials.    For  the  eleventh  graders,  this  percentage  was  65  percent.    A  much 
smaller  percentage  of  the  students  for  each  grade  took  three  or  more  readings 
of  the  temperature  during  their  investigation.    For  example,  13  percent  of  the 
seventh  graders  took  three  or  more  readings  for  the  blanket  test  and  11 
percent  for  the  plastic  test.    For  the  eleventh  graders,  39  percent  (triple 
the  percent  at  Grade  7)  took  three  or  more  readings  for  both  the  blanket  test 
and  the  plastic  test.    Fewer  seventh-grade  students  made  final  readings  than 
eleventh-grade  students.    For  example,  35  percent  of  the  seventh-grade 
students  made  final  readings  for  the  blanket  and  plastic  test.    For  the 
eleventh  graders,  the  percentatje  for  both  tests  was  60  percent.    Thus,  from 
the  findings  presented  above  it  would  appear  that  fewer  seventh-grade  students 
than  eleventh-grade  students  jaw  iKo  solution  to  the  problem  as  a  comparison 
of  cooling  curves.    Many  of  student.,  seemed  to  consider  a  simple  comparison  of 
before  and  after  as  an  appropriate  solution.    However,  both  seventh-  and 
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eleventh-grade  students  did  show  similar  performance  on  manipulation  of  the 
independent  and  control  variables. 

Recommendations  for  Future  Use 

The  Advisory  Panel  agreed  that  Survi val  would  be  an  appropriate  exercixe 
for  Grades  7  and  11  1n  a  national  assessment. 
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GRADE  3 


NAME  

SCHOOL  DISTRICT 
CODE  


Find  out  if  sugar  cubes  dissolve  faster  than  loose  sugar. 


Use  the  space  below  to  answer  the  question  in  the  box. 


Find  out  if  stirring  makes  any  difference  to  how 
fast  the  sugar  cubes  and  loose  sugar  dissolve- 


Use  the  space  below  to  answer  the  ssf^siioN  in  the  box. 
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Activity  Identification:    Sugar  Cubes 


Grade(s):    3,  7 

Method  of  Administration:    Individually  Administered  Investigation  (3), 
Self-Administered  Station  Activity  (7) 

Content  Area:    Sci ence-Chemi st ry 

Apparatus  required:    Six  small  glass  beakers,  sugar  cubes  in  packet;  six 
packages  of  granulated  sugar  each  containing  the  same  mass  of  sugar  as  in  one 
cube;  hot  water  in  thermos  (5n°C-60°C);  two  stirrers,  graduated  beaker, 
measuring  cup,  small  ruler,  paper  and  pencil. 


Individually  Administered  Investigation-  3 
Instructions  for  the  Administrator 


Show  the  student  the  sugar  cubes  and  the  packets  of:  sug^ii:  . 

For  this  question  you  irill  be  dissolving  sugar  in  vater.     In  each  of 
f  these  packets  is  the  same  amount  of  sxt%ar  as  there  is  in  one  cube  of  sugar. 

Pour  one  packet  of  sugar  into  a  beaker.     Pour  some  hot  water  in  (about 
half-full)  and  offer  student  a  stirrer  to  stir  the  water. 

Look  what's  happening  to  the  sugar.    «iat  would  you  say  is  happening? 

Accept  whatever  description  the  student  gives-  "disappearing",  "melting" 
or  something  comparable.     If  the  student  does  not  use  the  word  "dissolvir.V' 
say: 

The  word  to  describe  what  is  happening  to  the  sugar  is  "dissolving"-do 
you  knoK  that  word? 

If  the  student  says  "no"  repeat  slowly  "dissolving-  that  is  wliat  is 
happening  to  the  sugar". 

We  are  using  warm  water  because  sugar  dissolves  faster  in  warm  water  than 
2 aid  water. 

I  wonder  if  sugar  cubes  and  packets  of  sugar  dissolve  in  the  same  length 
f  tuae.    And  I  wonder  if  stirring  makes  any  difference?    These  are  the  things 
you  can  find  out  using  the  equipment  here  (A  should  point  to  each  object  as  it 
IS  mentioned).    You  have  several  packets  of  sugar,  all  with  the  same  amount  of 
sugar  as  in  one  cube.    There  are  some  more  boakers  and  one  which  can  be  used 
to  measure  water.    There  are  two  stirrers,  a  stopwatch,  a  ruler  and  some  paper 
to  label  things  if  you  want  to.    Let  me  lust  show  you  how  to  use  to  stop  watch 
(A  should  demonstrate).     Press  this  button  to  start  the  tix^r  (A  should  press 
the  start  button).    Press  this  button  to  stop  the  timer  (A  should  press  chat 
same  button  if  the  stopwatch  is  the  Armitron  used  in  training.  The 
instructions  may  need  to  be  adapted  if  another  type  of  stop  watch  is  used.) 
You  don't  net^  to  worry  about  this  middle  button  which  isn't  part  of  the 
.  timer.    Why  don't  you  play  with  this  for  a  little  while  so  you  can  make  sure 

f  that  you  know  how  to  use  it.     (A  should  let  the  student  play  with  the 

stopwatch  until  it  appears  obvious  that,  the  student  knows  how  to  use  it.  If 
the  student  spends  too  much  time  playing  with  the  stopwatch,  demonstrate  its 

use  one  more  time  and  then  move  on.)  You  don't  have  to  use  all  these  things, 
just  use  what  you  want . 

Turn  to  the  student's  response  sheet  and  read  out  the  part  in  the  box, 
pointing  to  each  word  so  he  can  see  it. 

Now  let's  look  at  your  sheet.    Here  it  says  what  you  are  finding  out. 
Let's  look  at  A.    Find  out  if  the  sugar  cubes  dissolve  more  quickly  than 
packets  of  loose  sugar.    Now  lets  look  at  B.    Find  out  if  stirring  makes  any 
difference  to  hov  fast  the  sugar  cubes  and  the  loose  sugar  dissolve. 
Row  there  is  a  space  here  at  A)  for  you  to  write  down  any  rotes  as  you  go 
along.    There  isn't  time  to  write  down  everything  you  do,  so  just  write  notes; 
to  help  you  rememb<»r  what  you  did  and  wSrat  you  found.    Then  write  down  the 
answer  to  the  question.    Then  at  B)  there  is  another  space  for  you  to  take 
some  notes  and  answer  the  question  in  the  box.    Do  you  understand  what  you 
have  to  do? 

Answer  questions  about  what  the  problem  is;  questions  about  how  to  tac^cle 
it  should  be  addressed  by  something  like: 

You  think  about  that  and  try  to  decide  what  is  the  best  way  to  do  it. 
Then  ask: 

Now  before  you  start,  just  to  make  sure  that  I  have  explained  things 
properly,  will  you  tell  me  lAat  it  is  that  you  are  going  to  find  out?    Mot  how 
you  are  going  to  do  it,  but  what  you  tr^er stand  the  question  to  be. 

)  Give  time  for  the  student  to  explain  in  his  own  words.     If  the  student 

hfi?  grasped  the  problem,  tall  him  to  go  ahead.     If  the  student  has  not  grasped 
the  problem,  go  over  the  parts  which  have  been  misunderstood.     When  you  are 
satisfied  that  the  student  understands  the  problem,  tell  the  student: 
2emember,  you  irill  have  about  20  minutes  to  work  on  this  investigation  which 
Q  should  be  plenty  of  time.  The  student  should  then  be  told  to  start  work. 
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Observations  daring  activity 

The      should  note  whether  the  student  takes  any  notes,  however  minimal. 
All  students  should  be  told  that  if  they  need  more  room  to  take  notes,  or 
write  answers  to  their  questions  that  they  should  use  tb^i  back  of  their  sheet. 
You  need  not  remind  the  student  to  take  notes. 

When  the  student  appears  to  have  finished  and  has  not  written  anything 
for  a  4  minute  period  of  time,  wait  to  be  sure  the  student  is  finished  and  the 
then  asks :     Have  you  finished? 

If  the  student  says  "yes",  the  A  says:     Remeoiber  you  have  to  put  doim 
vhat  you  found  on  your  paper. 

Follow-up  questions  to  be  asked  after  the  investigation 

(You  may  want  to  use  the  information  obtained  here  to  help  yOu  fill  in  the 
crieckl  ist) 

The  A  looks  at  the  student's  paper  and  asks:    May  I  see  what  you  .lave 
found? 

The  A  should  note  whether  the  findings  that  the  student  reports  are  the 
same  as  what  the  student  has  done.     The  A 

should  then  ask:     If  you  could  do  this  experiment  again,  using  the  same  things 
that  you  have  here  would  you  do  it  in  the  same  way  or  change  so«e  things  that 
yr-  did  to  make  the  experiment  better? 

The  A  should  give  the  student  plenty  of  time  to  answer.     If  the  student 
answer-  "the  same  way",  the  A  should  confirm  this  by  asking:  Would  there  be 
anythi-iig  you  would  change?     If  the  student  says  that  she  or  he  would  make 
changes,  the  A  should  ask  what  these  changes  are  and  confirm  that  they  are 
considered  to  be  improvements  by  asking  why  these  changes  would  be  better  than 
what  was  done  before. 

The      should  evaluate  the  student's  responses  for  a  critical  view  of  what 
has  been  done  rather  th?n  the  relative  utility  of  the  changes  specified. 
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NOT  STIRRING  (iv) 


NAME: 
CODE: 


SCHOOL  DISTRICT: 
Sugar  Cubes  Behavioral  Checklist 

1.  Loose  sugar  tested 

2.  Cube  sugar  tested 


SET-UP  (cv) 


3.  Volume  of  water  measured  -  by  eye 

4.  by  ruler 

5.  by  cylinder 

6.  Volume  used  <  10  cc 
7.  Volume  used  >  10  cc 

8.  Volume  same  for  both  types 

9.  Hass  same  for  both  types 


MEASUREMENT  (dv) 


RESPONSE  SHEET 


10.  No  apparent  measurement 

11.  Qualitative  measurement 
I   12.  Clock  used 

j  13.  within  +-  3  sees,  of  start  point 

I  14.  within  +-  3  sees,  of  end  point 

15.  Timed  -  until  all  dissolved 

16.  until  partially  dissolved 

17.  no  clear  end  point 

18.  Fixed  time  -  notes  amount  remaining 


1*19.  Reports  results  consistent  with  evidence 


STIRRING  (iv) 


SET-UP  (cv) 


20.  Stirring  not  tested  -  sugar  type  not  controlled  \ 

21.  Loose  sugar  tested 

22.  Cube  sugar  tested 

23.  Stirring  tested  -  by  counting  number  of  stirs 
24.  by  timing 

25.  Stirring  at  regular  intervals 

26.  Stirring  rate  -  constant 
27.  random 


28.  Volume  of  water  measured  -  by  eye 

29.  by  ruler 

30.  by  cylinder 
Volume  used  <  10  cc 
32.  Volume  used  >  10  cc 
Volume  same  for  both  types 


31 


33 


34.  Mass  same  for  both  types 


MEASUREMENT  (dv) 


35. 
36. 
37. 


40. 


43. 


No  apparent  measurement 
Qualitative  measurement 
Clock  used 

38.  within  +-  3  sees,  of  start  point 

39.  within  +-  3  sees,  of  end  point 
Timed  -  until  all  dissolved 

41.  until  partially  dissolved 

42.  no  clear  end  point 

Fixed  time  -  notes  amount  remaining 


RESPONSE  SHEET 


1*44.  Reports  results  consistent  with  evidence 


EVALUATION  OV  WORK 


45.  Uses  same  water  for  both  trials 
*46.  Repeats  trials  to  check  findings 

47.  Makes  notes  (however  minimal) 
*4d.  Acknowledges  that  procedures  could  be 

improved  if  experiment  repeated  "  aware 
that  certain  variables  could  be  controlled 

Check  off  all  those  which  apply: 

Scale  of  experiment 

(i.e.  would  need  more  apparatus;  not 
enough  time  to  experiment) 
Rate  of  stirring 
Use  of  volume 
Type  of  sugar  tested 
Volume  of  water  used 
Timing  interval  used 

Other  

(please  specify) 
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Scoring  of  thq  Response  Sheets 


Sugar  Cubes 
Grade  3 


A)  Score  2  pts.  for  correct  answer  of  Icose  sugar.    Score  1  p^.  for  an 
incorrect  answer  (i.e.  cube).    Score  0  for  no  response. 

B)  Score  5  pts.  for  a  response  which  states  that  both  types  of  sugar 
dissolve  faster  but  the  loose  sugar  still  dissolves  the  fastest.    Score  4  pts. 
for  a  responses  which  states  that  the  loose  sugar  dissolves  faster  than  the 
cube  and  that  stirring  or  not  stirring  is  the  cause  of  it  (i.e.  Stirring  makes 
a  big  difference.    The  loose  sugar  dissolved  much  faster.).    Score  3  pts.  if 
the  student  states  that  stirring  does  or  doesn't  make  a  difference  only  (i.e. 
It  doesn't)  or  how  or  why  an  effect  upon  the  sugar  is  found  only(i.e.  The 
stirring  makes  the  sugar  fall  apart).    Score  2  pts.  if  the  student  states  that 
one  type  of  for  sugar  dissolves  faster  than  another  only.    Score  1  pt.  for  an 
incorrect  response.    Score  0  for  no  response. 
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Third  Grade    Score  ?om  2 
A)    Use  the  space  below  to  answer  the  question  in  the  box. 


 LLl  m..  ^.(i^A 


A)    Use  the  space  below  to  answer  the  question  i;   the  box. 


A)    Use  the  space  below  to  answer  the  question  in  the  yox. 
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A, 


Third  '^!':'iDE    Score  Point  1 


Use  the  space  below  to  answer  the  question  in  the  box. 


Use  the  space  below  to  answer  the  question  in  the  bo/. 
vhgn  rhg  llmsr  '*^^<^'  — —  


Use  the  space  below  to  answer  the  question  in  the  box. 
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Third  Grade    Score  Point  5 
B)    Use  the  space  below  to  answer  the  question  in  the  box. 

  L-no^<^    <;ug^p    rn,^^^  li- 

 ^sl^  iiojo — VKi^.  r>tAbec   ^    i>  y^.ot  ^4: 


B)    Use  the  space  below  to  answer  the  question  in  the  box. 
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Third  ^rate    Score  Pom  ^ 


B)    Use  the  space  below  to  answer  the  question  in  the  bc  . 

^^€Sb    ir•^     J  t^g-y  ^fiC\:<rcA  ^orry 
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Third  Grade    Score  Poim"  3 
B)    Use  the  space  below  to  answer  the  question  in  the  box.  > 

^yyy^f^  AA/.  a^jtj^a,  ^J^^  ^  ^^^^  ^ 


B)    Use  the  space  below  to  answer  the  question  in  the  box- 


B)    Use  the  space  below  to  answer  the  question  in  the  box* 


478. 


Third  Grade    Score  Point  2 
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B)    Use  the  space  below  to  answer  the  question  in  the^box. 


B)    Use  the  space  below  to  answer  the  question  in  the  box. 


B)    Use  the  space  below  to  answer  the  question  in  the  box. 

JM^'t^\\fp'  -yy^n.n — b rSnr-  


  ?c«-^  ^ 

Third  ^irade    Score  Point  1 


I  - 

B)    Use  the  space  below  to  answer  the  .question  in  the  box. 




0- 


B)    Use  the  space  below  to  answer  the  question  in  the  box. 

jj-  U//  ^r.k^     //-H/^  s/Doh  on  


B)    Use  the  space  below  to  answer  the  question  in  the  box. 
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GRADE  3,7,n 

um^.  

SCHOOL  DISTRICT  . 

CODE  


How  DOES  THE  LENGTH  OF  THE  BOARD  CHANGE  HOW  FAST  IT  SWINGS? 
How   DOES   THE  WIDTH   OF  THE   BOARD  CHANGE   HOW   FAST   IT  SWINGS? 


A)    Use  this  space  to  make  any  notes. 


B)    What  difference  does  changing  the  length  make?  What 
difference  does  changing  the  width  make? 
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Activity  Identification:  Pegboards 
Grade (s):  3,7,11 

Method  of  Administration:    Individually  Administered  Investigation 
Content  Area:    Mathematics-Geomet ry/Science-Physics 

Apparatus  required:    Nine  pegboards  of  three  different  lengths  and  three 
different  widths,  stop  clock,  12-inch  ruler,  two  ring  stands,  two  clamps,  two 
rods  and  hooks  (picture  attached). 


Full  Investigation  -  9 

Instructions  for  the  Administrator  to  read  to  the  student:    A  has  the 
middle  length/middle  width  board  hanging  on  the  left  hand  stand  and  the 
short/wide  board  hanging  on  the  right  hand  stand  before  the  student  starts. 
Both  should  be  hanging  from  the  same  hole  (middle  one  on  top  row). 

A  gives  the  student  the  response  sheet  and  says:  I  have  a  problen  for  you 
aboat  these  boards  in  front  of  you.    Vatch  vhat  happens  when  I  start  then 
swing  ing. 

The  A  should  start  the  boards  swinging,  one  after  the  other,  casually, 
without  any  attempt  to  make  the  amplitudes  the  same. 

The  A  should  say:  Do  they  swing  just  as  quickly  as  each  other  or  is  one 
swinging  faster?    The  A  should  make  sure  that  the  student  identifies  which  is 
swinging  more  quickly.     The  A  should  stop  the  boards  swinging  and  look  at  them. 

The  A  then  says:    What  do  you  notice  about  the  length  and  width  of  these 
boards? 

The  A  should  let  the  student  say  which  is  longer  and  which  is  wider. 

The  A  then  says:     Yes,  they  are  different  in  length  and  in  width,  aren't 
they?    This  aight  be  making  a  difference  to  how  fast  they  swing.     In  a  minute 
you  are  going  to  use  these  things  for  an  experiment,  so  you  have  a  good  look 
at  then.     You  can  take  the  boards  off  like  this  (A  should  demonstrate)  and 
move  the  hooks  up  or  down  if  you  like  (A  should  demonstrate).     Tou  try  doing 
that  and  make  the  boards  swing. 

The  A  should  allow  2  or  3  minutes  for  the  student  to  play  with  the  boards 
and  stands.     When  the  student  has  finished  put  the  two  boards  with  the  other 
ones  laid  out  in  three  piles  by  length. 

The  A  then  says:     Now  there's  something  about  these  boards  that  I  want 
you  to  try  to  find  out.     See  if  changing  the  length  makes  any  difference  to 
how  fast  the  ..oard  swings  and  see  if  changing  the  width  makes  any  difference 
to  how  fast  It  swings.    You  can  use  any  of  these  boards-  these  wide  ones, 
these  middle  sized  ones  and  these  narrow  ones  (the  A  should  point  to  each 
pile).     There  also  is  a  ruler  and  a  stop  clock  for  you  to  use  if  you  think  it 
will  help  you  answer  the  questions.    This  is  how  you  can  use  the  stop  clock  (A 
demonstrates  how  to  start,  stop,  and  reset  the  watch).    Sow  you  try  it  (A  let7 
the  student  try  using  the  stop  clock). 

The  A  the  says:     Before  we  begin,  let's  read  together  what  it  says  on 
your  sheet  and  make  sure  you  understand  what  you  have  to  do  here.      A  reads 
the  information  printed  in  the  box  on  the  response  sheet  aloud  to  the  student 
How  does  the  length  of  the  board  change  how  fast  it  swings?    How  does  the 
width  of  the  board  change  how  fast  it  swings?    Here  is  a  space  (A  points  to  A 
on  the  response  shet)  where  you  can  write  down  what  you  find  out""as  you  go 
along.    When  you  think  you  know  Che  answers  to  the  two  qtaestions  (A  points  co 
the  questions  on  the  student's  response  sheet)  write  them  down  in  the  spaces 
that  are  given  at  B) .    Do  you  have  any  questions?  (A  should  wait  to  answer  any 
of  the  student's  questions  about  how  to  use  the  equipment  oi   about  the  task). 

The  A^  then  says:     low  before  you  start,  just  to  make  sure  I  have 
explained  everything  clearly,  you  tell  me  what  you  are  going  to  find  out. 

The  ^    should  note  the  way  that  the  student  formulates  the  investigation. 
If  the  student  has  put  it  in  terras  of  a  procedure,  the  ^  should  say:     Tell  m 
what  you  understand  the  problem  to  be,  not  what  you  are  going  to  do. 

When  the  A  is  satisfied  that  the  student  has  grasped  the  problem,  the  A 
should  say:     You  will  have  20  minutes  to  work  on  this  investigation  which 
should  be  plenty  of  time.    Okay,  let's  go  ahead. 


me 
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observations  during  activity 

During  the  activity,  the  A  should  rot  interrupt  the  student.     If  the 
student  asks  a  question,  the  appropriate  reply  should  be:     Tou  decide  hov  to 
do  it  or  You  can  use  anything  in  any  way  that  you  want,  etc. 

The  A  should  watch  the  actions  carefully  and  note  the  results  as  far  as 
possible  on  her  or  his  own.    The  checklist  should  be  used  to  keep  track  of 
which  boards  are  used  and  the  sequence  in  which  they  are  used  in  the  grid 
included  on  the  checklist  under  Length  (See  notes  on  completing  the  checklist 
for  more  information). 

When  the  student  appears  to  have  finished  and  has  not  recorded  anything 
more  at  B) ,  the  A  should  wait  to  be  sure  that  the  student  isn't  just  pausing 
ana  the  ask:     Ha«^e  you  finished? 

If  the  student  says  yes,  the  A  should  look  over  the  student's  paper  and 
ask:     'Jan  I  see  vhat  you  have  found? 

Vt.e  A  should  the  read  what  the  student  has  written  at  A)  and  B)  (and  make 
any  notes  on  the  checklist  if  needed  to  determine  whether  the  student's 
behaviors  and  rep  rt  of  findings  are  consistent)  and  ask:    Was  there  anything 
that  you  thought  ei"?ould  be  kept  the  sams  to  uke  the  test  fair?    If  the  A 
thinks  it  is  necess.^ry  to  follow  up  the  question,  the  A  then  should  ask:  Do 
you  think  anything  (-Ise  affects  the  results?  (The  A  should  mark  on  the 
checklist  if  another  viriable  was  taken  into  account  (e.g.,  the  position  of 
the  clamps  on  the  stan;*  . 

The  A  then  should  If  you  could  do  the  experiment  again,  using  the 

saMe  things  that  you  have  here,  would  you  do  it  in  the  s«e  vay  or  change  some 
things  that  you  did  to  make  the  experiMnt  better?    The  student  should  be 
given  plenty  of  time  to  answer  the  question.     If  the  student  says  that  she  or 
he  would  leave  things  the  same  way,  the  A  should  confirm  this  by  asking: 
Would  there  be  anything  you  iwuld  change?    If  the  student  says  that  changes 
would  be  made,  the  A  should  ask  about  those  changes  and  confirm  that  they  are 
improvements.     The  A  should  say:     Hov  vould  that  aake  the  experiment  better? 
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Scoring  of  the  Response  Sheets 


Pegboard 
Grades  3,7,11 


B)  Score  4  pts.  for  a  response  which  states  that  the  period  varies 
directly  with  the  length  and  width  makes  no  difference.    Score  3  pts.  for  a 
response  which  states  that  period  varies  directly  with  length  but  makes  no 
mention  of  width.    Score  2  pts.  for  a  response  which  states  that  period  varies 
directly  with  length  and  widlh  makes  a  difference.    Score  1  pt.  for  an 
incorrect  response.    Score  0  for  no  response. 
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LENGTH  (iv) 

Width 
Vide  Middle  Narrow 
+  +  +  + 

Long  I          I          I  I 
 +  +  + 

Med    I          I          I  I 
+  +  +  + 

Short!          I          I  I 
+  +  +  + 


NAME:   

CODE:   

SCHOOL  DISTRICT:  _ 

Pegboard  Behavioral  Checklist 

1 .  Length  varied 

number  of  boards  used  to  vary  Jengthi 

2.  9  boards 

3.  >=  3  boards 

4.  2  boards 

5.  Full  range  considered 

6.  extremes  only 

7.  adjacent  only 

In  the  grid  at  left,  record  the  sequence 
of  the  boards  used. 


WIDTH  (iv) 


AMPLITUDE  (iv) 


MEASURE^ENT  (dv) 
Counting 

Timing 


Width  varied 

number  of  boards  used  to  vary  width : 
9.  9  boards 

10.  >=  3  boards 

11.  2  boards 

12.  Full  range  considered 

13.  extremes  only 

14.  adjacent  only 

15.  random  selection 


19 


22 


by  ruler 


-  same  for  length  test 
test 


16.  Amplitude  measured 
17.  by  eye 
16.  not  measured 
Controls  Amplitude 

20.  same  for  width 

21.  same  for  both  tests 
Release  method  *  by  dropping 

23.  pushes  hard 

24.  same  release  method  for  both  tests 

25.  random  method  of  release 


In  the  diagram  at  left,  indicate  where  within  the 
swing  the  student  starts  the  movenent  of  the  board. 


26.  Clock  -  started 

27.  within  +-  2  sees,  of  release 
28.  Counted  -  number  of  swings  in  set  time 

29.  between  0-4  sees. 

30.  between  5-10  sees. 

31.  >  10  sees. 

32.  to  the  end  of  board  movement 
33.  Timed  -  one  swing 

34.  fixed  number  of  swings 

35 .  0-4  swings 

36.  5-10  swings 

37.  10-15  swings 

36 .  to  the  end  of  the  movement 


Comparison 


39.  Directly  compares  two  boards 

40.  by  eye 

41.  clocks  to  the  end  of  board  movement 

42.  clocks  to  the  end  of  movement  of  both  boards] 

43.  clock  stopped  within  +-  2  sees,  of  event  j 

44.  repeats  comparison  of  boards  to  check 

45.  no  apparent  measurement  or  judgement  used 


METHODOLOGICAL 
AWARENESS 


46.  Hakes  notes  (however  Dinimal) 

47.  Awareness  that  other  variables  need  to  be 
controlled;  acknowledges  that  aspects  of  the 
investigation  could  be  improved  - 

Check  off  all  those  which  apply: 

Scale  of  experiment 

(i.e.  would  need  more  apparatus;  not 
enough  time  to  experiment) 
Control  for  length  of  board 
Control  for  width  of  board 
Control  for  amplitude 
Use  of  clock 
Position  of  the  clamps 
Timing  interval  used 
Method  of  comparing  boards 

Other   

(please  specify) 
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Third  ^rade    Score  Pom 


)    What  difference  does  changing  the  lengv 

DI  FFERENCjE   DOES  CHANGING  THE  WIDTH  MRV  fV 
^tW  UWfr        ^vW?  U>±Uf.  .  

tr  -Tt>fl<  

AM5(tfER-'   

q\K£sr(oub]  — — =  


^?  What 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 

If /'-/-/ 5  /.ona  ./xnrJ  fcctc^r    tl^.oin   the.  shorfr  \r 

s>  ■ 


A)    Use  this  space  to  make  any  notes. 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 


SEVEhTTH  Grade    Score  Point  ^ 


a;    use  this  space  to  make  any  notes.  * 

UiJiJ.      1    \o\\^  vajTL     cauil     x^t- V  sA<rC  t    S^^im^    wt^.hV'  /^<^t-V  C 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES   CHANGING  THE   WIDTH  MAKE? 


ERIC 


B)    What  diVference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE? 


"///<>^^         -^Ac^        ri/y       fl^.^  ^         ^<^0U'^       i4        ^V^<r  /^<Jt/<:     ^^^^  ^  
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Seventh  Grade    Score  Poiwt  4 


A)  Use  this  space  to  make  any  notes,  "ivi  \^^/Oj^tc\'oi/\ 

B)  What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 


iV  c^Q  4^0.^4  WAX  A 


SKci-rV  tor^  V4 


/ 
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Eleventh  Grade    Score  Point  ^ 
A)    Use  this  sv>ace  to  make  any  notes- 


B)    What  difference  does  changing  the  length  make?  What 
difference  does  changing  the  width  make? 


-tu 


(GING  THE  WIDTH  MAKE?  /    ..  / 

/    .     .  ZZ       ,  '  .  ^  


A)    Use  this  space  to  make  an^  notes. 


1  iS)  1 

)o;io 

1  11. 10 

^'^tS  at?(iu.4  4V  30.^(^0^. 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE? 

w/^-Hg    In  c  {fa.  ies         rg..  ( <:  - 


 —  


ERIC 
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ELEVE^^TH  Grade    Score  Point  ^ 


A)    Use  this  space  to  make  any  notes. 


ERIC 
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Third  Grade    Score  Poim"  3 
B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 

4nai  ore  'li^e  ■  somp    i^.d-fA  nf\J  One  hrYArrJ 
— L£  lander,  -f'/ic^  •  I<}ncjen.'.h6pirrl  a^e^  -(cxsicr 


A)    Use  this  space  to  make  any  notes. 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE? 


ERIC 


A)    Use  this  space  to  make  any  notes. 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE.W.IDTH  MjAKE?  /) 

^'^  '^'^y  "^'r     ^  /V/>7  v/-<  /of 


4^ 


Third  Grade    Score  Pom  2 
B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES   CHANGING  THE  WIDTH  MAKE? 


A)  Use  this  space  to  make  any  notes- 

B)  What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE? 


ERIC 
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Use  this  space  to  make  any  note£.       .       ^  a  I 


What  difference  does  changing  th^^  l-ngt-'  •••a^^''^  Wy- 

difference    does   changing   the   width   f-Ai^E?  "  f  ^ 


j^^^    ^^^^         Pyr4    -ij^,,  ^^^^  -jM^.^. 


/4  QO 


Seventh  ^rade    Score  Point  2 
B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE?  ^  


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES  CHANGING  THE  WIDTH  MAKE? 


Lo(^r<^^        'ft^^^  Skfc^T-  

A)  ^SE   THIS   SPACE   TO  MAKE  ANY  NOTES. 

utlU^  ^  r\  .  Z      ~  " — — '  '^'  .j- - 

B)  What  difference  does  changing  the  length  make?  What 

DIFFERENCE   DOES   CHANGING  THE  WIDTH  MAKE? 


ERIC  4aa 


Eleventh  ^irade    Score  Point  2 
Use  this  space  to  make  any  notes. 

Ud\CLe.  red.  ^  ,  \c  -soocn^'b  -  i  Q..  6^ 
red.  ^    "  ^ 

What  difference  does  changing  the  length  make?  What 
difference  does  changing  the  width  make? 

^-VQ.   t^VvQ-CXjz^   J^7cxx^vldv^  jb.x.^^<y^  S^C\.>XCl.K 

^lA^'tK^  .j^^gnar.^  .Qjoajurh:^  ^A  j^y^yxa  ■  - 


Use  this  space  to  make  any  notes 


What  difference  does  changing  the -length  make?  What 
difference  does  changing  the  width  make? 


ElEVEhTTH  SrADE     ScORE  PoHJT  2 


Use  this  space  to  make  any  notes.  ,/     z,^  /o 


What  difference  does  changing  the  length  make?  What 
difference  does  changing  the  width  make? 
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Third  ^^rade    vScore  Point  1 


B)    What  difference  does  changing  the  length  maki^  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 


^  0.- 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 


B)    What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES   CHANGING  THE  WIDTH  MAKE? 


ERIC 
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Seventh  ^irade    Score  Point  1 


Use  this  space  to  make  any  notes. 

+hQn    ^he    (onqer  boarc/. 

-'v-bf-  ^rrni r'loSorc/  <§Hi  ^5 

What  difference  does  changing  the  length  make?    What'  '  - 
difference  does  changing  the  width  make? 

QK^rj      i-)r\lr\  go  Q-S  fil^f  O-^  


n 


^V\-t    '%S\r\  ":A0rO    tCOrxk    9P  Qs 

+te    sho^-=  ^^^^  ^tt-r 
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Seventh  Srade    Score  Pom  1 


Use  this  space  to  make  any  notes. 

'5^ ^  ^.^w^ 

What  difference  d(^s  changing  the  length  makI^  What 
difference  does  changing  the  width  make? 


^  w 


JyrA'^jiA'  

Use  THIS  space  to  make' any  notes. 

2^--  /^^  ^..^  ^  ^  ^^^^^^ 

^^"^  J*^ w  ^^-^  ^  ^  ^  ial. 

^  f^^:^^  5^ZJ,  ''^^ 

What  difference  does  changing  the  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 
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Eleventh  Grade    Score  Point  1 


A)    Use  this  space  to  make  any  notes. 


B)    What  difference  does  cHANGrNGTHE  length  make?  What 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE? 


\o  ^       >  .  .  


A)    Use  THIS  space  to  make  any  notes. 

\/2tii/yixA^  Jcr^  ^^-^^^ ^JAe.  ^ -/^-y 


i B)    What  difference  does  changing  the  length  make?    What  \ 

DIFFERENCE  DOES  CHANGING  THE  WIDTH  MAKE?  V 

 ^  ^  ^  

o 
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Eleventh  Grade    Score  Point  1 


(Cm 

Use  this  space  to  make  any  notes. 


What  difference  does  changing  the  length  make?    What  ^ 
difference  does  changing  the  width  make?  /^~\ 

D  3 


500 


GRADE  7,11 


NAME   ._ 

SCHOOL  DISTRICT 
CODE   


Would  THE  box  weigh  most  completely  filled  with  material  A.  or 
WITH       OR  WITH  C?    With  which  would  it  weigh  the  least? 


You  CAN   USE   ALL   THE   THINGS   ON  THE   TABLE   TO   HELP  YOU   FIND  THF 
ANSWERS. 

A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

The  box  would  be  heaviest  filled  with  material   . 

The  box  would  be  lightest  filled  with  material   . 


ERIC 
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Activity  Identification: 


Density 


Grade(s):  7,11 

Method  of  Administration:    Individually  Administered  Investigation 
Content  Area:    Mathematics -Geometry /Science-Physics 

Apparatus  required:    Three  blocks,  labelled  A,  B,  and  C  of  different  sizes, 
shapes,  and  densities;  a  large  open  box;  spring  scale,  ruler,  hand  calculator, 
paper  and  pencil  (Note:  The  blocks  will  be  a  rectangular  solid,  a  cube,  and  a 
triangular  block  which  is  half  a  rectangular  solid.) 


Individually  Administered  Investigation-  7,11 


The  A  hands  the  student  Che  response  sheet  and  says:     You  are  going  to 
Cry  to  find  the  answer  to  a  few  questions.    What  you  need  to  find  out  i^^ 
explained  on  this  page.    Read  it  and  then  1*11  answer  any  questions  you  aay 
have« 

After  the  student  finishes  reading  the  response  sheet,  A  says:     Do  you 
understand  what  you  need  to  find  out?  should  answer  any  questions  other 

than  those  concerning:  possible  approaches  to  the  problem.)    Rememher  that  you 
have  to  suppose  that  the  open  box  could  be  completely  filled  with  the  material 
that  comprises  each  of  the  blocks.    You  will  have  15  minutes  to  work  on  this 
investigation  which  should  be  plenty  of  time. 

Observations  during  activity 

If  the  student  is  inactive  for  4  minutes  the  A  asks:     Are  you  stuck? 

If  the  student  says  "no",  the  A  should  ask  the  student  if  she  or  he 
Understands  the  task  and  what  has  to  be  done.     If  the  student  is  clear  about 
what  has  to  be  done,  the  A  asks:     Okay,  i^y  don't  you  try  to  get  started? 

If  the  answer   is  "yes",  the  A  should  give  the  following  prompt:  Note 
that  each  of  the  blocks  is  a  different  size  and  shape  and  made  of  a  different 
kind  of  wood.    What  do  you  need  to  know  about  each  block  to  decide  with  which 
kind  of  wood  would  a  filled  box  be  heaviest  or  the  lightest?    Remember  you 
have  a  scale  to  weigh  things  and  a  ruler  to  measure  things.    Think  about  how 
you  can  use  them  to  help  you  find  the  answers. 

The  should  note  whether  the  student  takes  any  notes,  however  minimal. 
The  student  need  not  be  reminded  to  take  notes. 

When  the  student  appears  to  have  finished  and  has  not  written  anything 
for  a  4  minute  period  of  time,  the  A  should  wait  to  be  sure  the  student  is 
finished  and  then  asks:    Have  you  finished? 

If  the  student  says  "yes",  the  A  says:     Remember  you  have  to  put  down 
what  you  found  on  your  sheet . 

The  A  then  should  look  at  the  student's  paper  and  ask:  Can  I  see  what 
you  have  done? 

The       should  note  whether  the  information  recorded  is  consistent  with 
those  findings  reported  on  the  response  sheet.     If  the  A  is  in  doubt  of  the 
student's  approach,  particularly  the  use  of  a  correct  or  an  alternative 
formula  to  compute  a  given  measure  the      should  make  inquiries  about  the 
student's  behavior.    For  example,  if  the  A  is  unsure  how  the  densities  of  the 
blocks  were  found  the  A  should  ask:     Show  me  or  tell  me  how  you  figured  out 
the  densities  for  each  of  the  blocks.    Uhat  did  you  do  to  make  it  possible  for 
you  to  conpare  the  materials  accurately? 

If  the  is  unsure  of  which  strategy  the  student  used  to  determine  with 
which  material  the  box  would  weigh  the  most/least^-  the  A  asks:  What  did  you 
do  to  figure  out  the  answers  to  the  two  questions  in  the  box  on  your  sheet? 

If  the  A^  is  unsure  whether  the  student  considered  the  number  of  blocks 
that  fit  into  the  box  the  A^  should  ask:  Was  it  necessary  to  figure  out  how 
many  of  each  kind  of  block  would  fit  in  the  box? 


Scoring  of  the  Response  Sheets 


Density 
Grades  7,11 


er|c  504 


BLOCK  WEIGHT 


NAME:  ^  

CODE:   

SCHOOL  DISTRICT: 


4. 


Density  Behavioral  Checklist 

Weighs  Blocks  -  Block  A 

2.  Block  B 

3.  Block  C 

Records  weight  of  blotks  -  in  grams 

5.  in  ounces 

6 .  inconsistently 

Does  not  record  weights 


BLOCK 

MEASUREMENT 


11. 


14 


Measures  Blocks  -  Block  A  (cube)  -  3  dimensions 

9.  1  or  2  dimensions 
10.  does  not  measure 
Block  B  (rectangular)  -  3  dimensions 

12.  1  or  2  dimensions 

13.  does  not  measure 


Block  C  (triangular)  -  2  dimensions  of  base  and 
vertical  height 

15.  2  dimensions  of  base  and  slant  height 

16.  1  or  2  dimensions  only 

17.  does  not  measure 

18.  Records  measurements  *  in  centimeters 

19.  in  inches 

20.  inconsistently 

21.  does  not  record 


BLOCK  VOLUME 


22.  Measures  Volume  -  Block  A  -  uses  a  correct  formula 

23.  uses  an  incorrect  formula 

24.  does  not  compute 

25.  Block  B  -  uses  a  correct  formula 

26.  uses  an  incorrect  formula 

27.  does  not  compute 

28.  Block  B  -  uses  a  correct  formula 

29.  uses  an  incorrect  formula 

30.  does  not  compute 


DENSITY 
COMPUTATION 


31.  Computes  Density  -  using  a  correct  method 

32.  using  an  incorrect  method 

33.  estimates  by  "eyeballing** 

34.  does  not  compute  densities  directly 


BOX 

MEASUREMENT 


35.  Measures  Box  -  uses  3  dimensions 

36.  uses  1  or  2  dimensions 

37.  does  not  measure  boxes 

38.  Computes  Volume  of  Box  -  using  a  correct  method 

39.  using  an  Incorrect  method 

40.  does  not  compute 

41.  Number  Blocks  fitting  in  box  -  estimates  by  **eyeballing" 

42.  computes 

43.  does  not  consider 


METHODOLOGICAL 
AWARENESS 


44.  Overall  approach  used  -  computes  and  compares 
densities  without  using  the  box 

45.  computes  volume  &  number  of  each  block  to  fill  box 

46.  estimates  number  of  each  block  to  fill  box 

47.  uses  a  combination  of  methods 

46.  develops  unique  strategy  (specify) 

49.  no  apparent  strategy 

50.  Determines  heaviest 

51.  Response  consistent  with  findings  above 

52.  Determines  lightest 

53.  Response  consistent  k'itb  findings  abo^e 

54.  Repeats  measurement  -  for  blocks 

55.  for  volumes 

56.  for  densities 

57.  for  measureraent  of  the  box 

58.  for  all  measucetnents 

59.  does  not  repeat  an^  »«&s\iremenx% 
60.  Makes  notes  (however  minimal) 
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SEVE^m^  Frade   Score  Point  3 


A)    Use  this  space  to  keep  any 

FIND  OUT. 


OTES  ON  WHAT  YOU  DO  AND  WHAT  YOU 


Or 


ERIC 


B)  Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  . 
The  box  would  be  lightest  filled  with  material  . 

A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

^    FIND  OUT. 

^oK  vKe  W  V\os\^J_J^^ 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

The  box  would  be  heaviest  filled  with  material  2}--  \ 
The  box  would  be  lightest  filled  w^ith  material  _C- 

-^'x-^  xM-O  -VV\e   box     ^\yjc^  HQCZ. 
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SEVEhfTH  Frade    Score  Pom  3 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT- 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

'3 


The  box  would  be  heaviest  filled  with  material 


The  box  would  be  lightest  filled  with  materiai  C. 
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Eleventh  ^^rade    Score  ^^oim"  3 
A)    Use  this  space  to  keep  any  notes  on  what  you  do  aiw  what  you 

FIND  OUT. 

^  \/^?iu»'»e  oi'^.o^-.  wCuX*^; 

S      L.'TCr^  ^  for        i^qr  6 

hiLL    IN  THE  BLANKS  TO  COMPLETE  THE   SENTENCES  BELOW: 

The  box  would  be  heaviest  filled  with  material  g  . 
The  box  would  be  lightest  filled  with  material 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT.  ...^t- 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material 
The  box  would  be  lightest  filled  with  material  _Ci- 


508 


A) 

^  A 

B) 


El_EVEt^H  TIRADE     ScORE  Poim"  3 

Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND   out.  V  '  D  " 


Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  B  . 
The  box  would  be     ghtest  filled  with  material  0.  . 
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Seventh  ^^rade    Score  Point  2 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

The  box  would  be  heaviest  filled  with  material  .  ""^^J^ 
The  box  would  be  lightest  filled  with  material    ^  « 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

F I ND  OUT'    _  t  V       ^      , . 

\^r^  l\  err. 

©-54  Or-  P^-^Cl.on 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

TmE  box  would  be  heaviest  FILLED  WITH  MATERIAL  , 

The  box  would  be  lightest  filled  with  material  _C-    V  ^ 
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SEVEhTTH  Grade    Score  Point  2 

Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  P\  . 
The  box  would  be  lightest  filled  with  material  O. 
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Eleventh  Grade    Score  Poim-  2 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 


B)    Fill  in  the  blanks  to  complete  the  sentences  below:  -*i  a> 

The  box  would  be  heaviest  filled  with  material  A_'  ^^^^  ^ 

The  box  would  be  lightest  filled  with  material  Cy  » 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 
^^^^  °"^*  "^^C; 


_         >  I      3  u  Z?  ^  ' 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

The  box  would  be  heaviest  filled  with  material  f  'J^J 

The  box  would  be  lightest  filled  with  material  ^  . 


ERIC 
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ELEVEhTTH  Grade    vScore  Pcintt  2 
A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 

"^^^  B)    Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material 
The  box  would  be  lightest  filled  with  material    f\  » 


ERIC 


Seventh  'irade    Score  Point  1 
A)    Use  this  space  to  keep  any  notes  on  what  you  do  andwhat  you 

FIND  OUT. 


B)  Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  A  . 
The  box  would  be  lightest  filled  with  material  6>. 

F?ND™;i.'""  "  ON  WHAT  VOU  DO  AND  WHAT  YO. 


B)      F,LL    ,N  THE   BLANKS   TO  COMPLETE   THE   SENTENCES  BELOW: 

The  BOX  would  be  heaviest  filled  with  material  jL.  A 
The  Box^ouLD  be  lightest  filled  with  material  a.  ^ 
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Seventh  Grade    Score  Point  1 


A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 

t 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heavicST  filled  with  material 
The  box  would  be  lightest  filled  with  material  jS.* 
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Eleventh  Grade    Score  Point  1 

fund's;?.'''''  '°  ''''  '''''   °N  WHAT  YOU  DO  AND  WHAT  YOU 


B)    Fill  in  the  blanks  to  complete  the  sentences  below: 

The  box  would  be  heaviest  filled  with  material  Qn.- (  V  ) 
The  box  would  be  lightest  filled  with  material  Ji. 

A)  Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 
find  out.  .  _  ^  \ 

^  -    no  y.^        y  X  ^    ^  y 

B)  Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  jC_- 
The  box  would  be  lightest  filled  with  material 


o  516 

ERIC 


Eleventh  Grade    Score  Point  1 
A)    Use  this  space  to  keep  any  notes  on  what  you  do  and  what  you 

FIND  OUT. 


B)  Fill  in  the  blanks  to  complete  the  sentences  below: 
The  box  would  be  heaviest  filled  with  material  (j  . 
The  box  would  be  lightest  filled  with  material  - 

toe  octjiild  be  hea-vie^jrf  iS^"^  rr^a-kriQl  < 
becdx^      boe\aJ^5  r^o^  ^005  ft  or  B .  l-^'^ 
iOidVh  10  OjCfecner  al^:>  ihc^n  boih  ft  and  'b 
tl^efrfore  iV  uxuld  be  ^■^G5^  tx-ava  tr^k.na\ 

Yh,e  bc<  u:ai\di  be.  \^o£>  hikva  u:t+h  ma+enal  B. 

VhDTi  R  oe.       because  o-  iV^s  l€-^r  (tor^^ro^m 
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NAME  

SCHOOL  DISTRICT 
CODE   


Which  fabric  will  keep  you  warmer  in  cold^  dry  weather? 


Use  this  space  to  keep  notes  on  your  work. 


What  did  you  find?    Which  fabric  will  keep  you  warmer? 


518 


Activity  Identification:    Survi val 


Grade:  7,11 

Method  of  Administration:    Individually  Administered  Investigation 
Content  Area:  Science-Physics 

Apparatus  required:    Five  cans  labelled  A-E  (two  identical  aluminum  cans  A  and 
B,  one  plastic  can  E  with  the  same  dimensions  as  A  and  B,  one  aluminum  can  C 
that  is  the  same  height  as  A,  B,  and  E  but  of  a  larger  diameter,  one  aluminum 
can  D  with  the  same  diameter  as  A,  B,  and  E  but  shorter  height);  110°C 
thermometer,  rubber  bands,  pins,  transparent  tape,  scissors,  electric  kettle> 
two  measuring  cups,  sheets  of  blanket,  sheets  of  plastic,  fan,  small  ruler, 
graph  paper,  cold  water  container  with  sr,upper,  paper  towels,  pencils. 
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Individually  Administered  Investigation-  7,11 


Isaglae  that  you  are  about  to  take  a  trip  on  which  you  could  be  stranded 
on  a  mountainside  in  cold,  dry,  windy  weather.     You  can  choose  to  take  one  of 
the  fabrics  in  front  of  you  to  help  keep  you  warm  (A  points  to  the  two  - 
materials).    What  you  will  need  to  find  out  is  (A  points  to  the  student's 
response  sheet): 

Which  fabric  will  keep  you  warmer? 

I'll  go  through  the  equipment  with  you: 

There  is  (A  points  to  each  piece  of  equipment  as  it  is  mentioned)   a  kettle  to 
heat  water,  a  supply  of  cold  water,  rubber  bands,  pins,  transparent  tape,  a 
ruler,  a  stop  watch  for  timing  things  (A  allows  the  student  to  practice 
starting,  stopping,  and  resetting  the  clock),  various  cans,  measuring  cups, 
thermometers,  a  fan    (A  allows  the  student  to  switch  the  fan  on  and  off),  a 
roll  of  paper  towels,  and  paper  and  pencil  to  record  what  you  f ind - 

Let  me  give  you  a  few  suggestions  about  how  you  can  find  out  vhich 
material  will  keep  you  warmer: 

o    use  a  tin  can  instead  of  a  pf?.raon 

o     put  hot  water  inside  to  makw   the  can  more  life-like 
o    make  the  can  a  cover  from  the  fabric 
o    use  a  fan  to  make  an  imitation  wind 

Do  you  have  any  questions?     (A  addresses  any  questions  f:he  student  has 
about  using  the  equipment  or  about  the  task  without  addressing  specific 
questions  about  how  the  equipment  may  be  applied  to  the  investigation  or  ways 
the  student  may  approach  the  investigation.)    Okay,  let's  begin.  Remember, 
you  have  to  find  out  v4iich  fabric  will  keep  you  warmer.     You  may  use  as  much 
fabric  as  you  need.     You  will  have  45  minutes  to  work  on  this  investigation 
tihich  should  be  plenty  of  time. 

Observations  during  activity 

If  the  student  has  been  inactive  for  a  period  of  4  minutes,  the  A  should 
ask:  Are  you  stuck? 

If  the  student  says  "no",  the  A  should  say:  Okay,  continue  your  work.  If 
the  student  says  "yes",  the  A  should  say:  Just  try  to  think  about  what  you 
might  do  if  you  were  in  the  situation  described  on  your  sheet.     Just  do  what 
you  think  is  the  right  thing  to  do  to  answer  the  question. 

After  the  student  has  appeared  to  finish  doing  work,  wait  for  a  short 
period  of  time  to  make  sure  the  student  isn't  just  pausing  and  then  the  A 
should  aok:  Are  you  finished?  (If  the  student  says  "yes"  the  A  should 
continued     Can  I  see  what  you  have  done? 

The  A  then  should  ask:  If  you  could  do  this  experiment  again,  using  the 
same  things  that  you  have  here,  would  you  do  it  in  the  same  way  or  change  some 
things  that  you  did  to  make  the  experiment  better?    The  A  should  give  the 
student  plenty  of  «■  ime  to  answer  the  question.     In  the  ar.:>wet  the  A  should 
look  for  a  critical  view  of  what  has  been  done  rather  than  changes""wh ich  are 
necessarily  better. 


EKLC 


Survival 
Grades  7,11 


8)  Score  4  pts.  for  the  correct  answer,  plastic,  with  notes.    Score  3  pts. 
for  the  correct  answer  without  notes.    Score  2  pts.  for  an  incorrect  answer 
with  notes.    Score  1  pt.  for  an  incorrect  answer  without  notes.    Score  0  for 
no  response. 
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NAME;   

CODE;   

SCHOOL  DISTRICT: 


Survival  Behavioral  Checklist 


blan  plas 
ket  tic 


MATERIAL  (iv) 


1. 


Material  used 
2.  plastic 


blanket 


SET-UP  MATERIAL 


SET-UP  WATER 


12. 


15. 
7.6. 


Material  used  alone 
Material  tested  in  water 
Material  around  -  hand 
6.  thermometer 

Material  around  can  -  A  or  B 

8.  C 

9.  D 

10.  E 

11.  cylinder 

Used  material  for  less  than  1  layers 

13.  plus  a  lid 

14.  plus  a  base 

Used  material  only  as  a  cover 
Material  fixed/held  in  place 


17.  Used  hot  water  (>  60  C)  in  can 

18.  Used  warm  water  (35  -  60  C)  in  can 

19.  Used  cold  water  (<  35  C)  in  can 

20.  Water  measured  -  by  cylinder 

21.  by  ruler 

22.  by  eye 

23.  Water  not  measured 

Actual  Volume  used  fcr  each  material: 


Blanket 


<l/2  full 
1/2  full 
3/4  full 


Plastic 


<l/2  full 
1/2  full 
3/4  full 


MEASUREMENTS 
(dv) 


24. 
25. 
26. 
27. 

29. 
30. 
31. 


34. 
35. 
36. 
37. 


42. 


45, 
46, 


Baseline  measure  of  water  before  starting 

Read  initial  temp,  thermometer  on  outside  of  can 

Thermometer  used  correctly  (in  water) 

Clock  used  accurately  (+-  5  sees,  of  reading  temp.) 

28.  used  inaccurately 

Recorded  temp,  at  regular  intervals 

Recorded  temp,  at  irregular  intervals 

Number  of  temp,  readings  made;  2 

32.  3-5 

33.  >S 

Read  final  temp,  of  water 
Read  final  temp,  after  fixed  time 
Read  final  time  after  fixed  temp,  drop 
Time  interval  -  <  1  minute 

38.  1-2  min. 

39.  >2-5  min. 

40.  >S-10  min. 

41.  >10  min. 

Used  fan  -  to  cool  cans 

43.  to  blow  air  through  material  alone 

44.  to  dry  material 

Fan  used  consistently  for  both  materials 
Acknowledges  that  changes  could  be  made  in 
the  procedure  -  aware  that  other  variables 
could  be  controlled. 

Check  off  all  those  which  apply: 


Scale  of  experiment 

(i.e.  would  need  more  apparatus;  not 
enough  time  to  experiment) 
Use  of  materials 
Use  of  water 

Measurement  of  water  temperature 
Timing  interval  used 
Use  of  fan 
Other 


(please  specify) 


CONTROLS  (cv) 


Material  Q 


J 


Fastening  I  I 


Temp .  I 
Cooling 
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Seventh  Grade    Score  Point  ^ 
B)    What  did  you  f.ind?   Which  fabric  will  keep  you  warmer?- 

Vccho^\^  filcktirHc  b^cao'u  ^ur^^T  ft 


A)    Use  this  space  to  keep  notes  on  your  work^ 


j^eg 4-1^  LOg-igf  WHf  r    Sicj-^^  core         m e 

^   ,  V 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 


A)    Use  this  space  to  keep  notes  on  your  work. 


B)    What  did  you  find?   Which  fabric  will  keep  you  warmer? 


ERIC 


Eleventh  Grade    Score  Point  ^ 


A)    Use  this  space  to  keep  notes  on  your  work.  \  1/ 

'pW+vC    4^:<\5f;c{  V/<^^^'^      -hio^p,  5VC 


c 


B)    What  did  you  find?   Which  fabric  will  keep  you  warmer? 


A)    Use  this  space  to  keep  notes  on  your  work. 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 


I 
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Eleventh  Grade    Score  Point  4 
A)    Use  this  space  to  keep  notes  on  your  work.. 

t^^O  C  -  -  "''^^  '^^1 

I  B)  ^jWhat  did  you  find?    Which  fabric  will  keep  you.  warmer?  / 

cj)  icu^  ilcd'  a  \Km/>^  bocLfO  3^^^^.  cU/rp^l  I  ^C  i/,>M^vy  c&D^J 

LoC^  l-djAz^  P^^^,<t  oUcmd  tk  ti,^ '  -6)  oU^  . 

cj  J  cuo^  c<>^»i^tkl  a/^vt^t*^•^  V^Yvv/m^  oMMdcCi^^ 


ERIC 
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Seventh  Prade    Score  Pqint  3 
B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 

pCfi\<,i}  r  C^.r,L(I<L      keep  Co<p  (.if^r^mi?r-. 


B)    What  did  you  find?   Which  fabric  will  keep  you  warmer*? 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 
^^^^^^   ^  vA/vA  If  ^  .xj^/OlW  ^ 

^^^^^ 
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EifVEm-H  f^RADE    Score  Pqint  3 
What  did  you  find?    Which  fabric  will  keep  you  warmer? 

i^€.ld  "^kc*  vof^CiY-  ''^.tr^  oufiijitJ\))  La^fP-^hi.  acid 
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SEVEmn  Grade    v^core  Point  2 

A)  Use  this  space  to  keep  notes  on  your  work. 

B)  What  did  you  find?    Which  fabric  will  keep  you  warmer? 


A)  Use  this  space  to  keep  notes  on  your  work- 

^v^^   wool  ,^5:^  ■^ou.^f, 
fff.  "^^V.woc/s^a  5^  -1  OxU^- Deques n'-f 

B)  What  did  you  find?    Which  fabric  will  keep  you  warmer? 


ERIC 


528 


I 


Seventh  ^:^rade    Score  Point  2 


A)  Use  this  space  to  keep  notes  on  your  work. 

B)  What  did  you  find?   Which  fabric  will  keep  you  warmer? 


Co  Tk.  ,  <^n^  1«+  ,  ^ 


ERIC 
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ELEVEfTTH  Grade    Score  Point  2 


A)  Use  this  space  to  keep  notes  on  your  work. 

B)  What  did  you  find?    Which  fabric  will  keep  you" warmer? 

m3u(^^J2>^r.   X    ciidp}'+   lilct  ^-^^^ 
lOOi-    due  ^  /<^ot  df'  /W^Wcy-.  or 
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Eleventh  Grade    Score  Point  2 


Which  fabric  will  keep  you  warmer  in  cold,  dry  weather? 


A)    Use  this  space  to  keep  notes  on  your  work.'^^^''^  <=d^^d^^ 

^^^^o.i  5^  ^^■^^or<4^{j^^'^       ^^^^  4! 

jr^^^B)    What  did  you  find?    Which^ric^^wS^l'^keep  you  warmer?  " 

"     ''^   ^         >     /'^(^    ^J^Lw  . 

^^^^         u.^.o'  ^^fc   


5 


3  o  — 


ERIC 
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Eleventh  Grade    Score  Point  2 


Which  fabric  will  keep  you  wa^wfr  in  coi^d,  "py  ,meather? 


A)    Use  this  sp^ce  to  keep  notes  on  your  work. 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer?  '-^^ 


^<J2S2^^>  ij^ljt.  ^-z^-t-^^t-t^ 
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Seventh  ^rade    Score  Point  1 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 

Keep 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 


B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 
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Eleventh  Grade    Score  Point  1 
B)    What  did  you  find?    Which  fabric  will  keep  you  warmer? 


ERIC 
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